-- Logs begin at Wed 2022-09-14 12:19:53 UTC, end at Wed 2022-09-14 13:16:19 UTC. -- Sep 14 12:45:28.363921 dv-cinder-820027-30-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 14 12:45:28.373690 dv-cinder-820027-30-smb devstack@keystone.service[81471]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 14 12:45:28 2022] *** Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: nodename: dv-cinder-820027-30-smb Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: machine: x86_64 Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: clock source: unix Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: pcre jit disabled Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: detected number of CPU cores: 4 Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: current working directory: / Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: detected binary path: /usr/bin/uwsgi-core Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: your processes number limit is 47680 Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: your memory page size is 4096 bytes Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: detected max file descriptor number: 2048 Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: lock engine: pthread robust mutexes Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: thunder lock: enabled Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 14 12:45:28.378872 dv-cinder-820027-30-smb devstack@keystone.service[81471]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 14 12:45:28.417708 dv-cinder-820027-30-smb devstack@keystone.service[81471]: Python main interpreter initialized at 0x55a9ef12a9c0 Sep 14 12:45:28.417708 dv-cinder-820027-30-smb devstack@keystone.service[81471]: python threads support enabled Sep 14 12:45:28.417708 dv-cinder-820027-30-smb devstack@keystone.service[81471]: your server socket listen backlog is limited to 100 connections Sep 14 12:45:28.417708 dv-cinder-820027-30-smb devstack@keystone.service[81471]: your mercy for graceful operations on workers is 90 seconds Sep 14 12:45:28.418111 dv-cinder-820027-30-smb devstack@keystone.service[81471]: mapped 403077 bytes (393 KB) for 2 cores Sep 14 12:45:28.418190 dv-cinder-820027-30-smb devstack@keystone.service[81471]: *** Operational MODE: preforking *** Sep 14 12:45:28.418451 dv-cinder-820027-30-smb devstack@keystone.service[81471]: *** uWSGI is running in multiple interpreter mode *** Sep 14 12:45:28.418451 dv-cinder-820027-30-smb devstack@keystone.service[81471]: spawned uWSGI master process (pid: 81471) Sep 14 12:45:28.418668 dv-cinder-820027-30-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 14 12:45:28.420619 dv-cinder-820027-30-smb devstack@keystone.service[81471]: spawned uWSGI worker 1 (pid: 81481, cores: 1) Sep 14 12:45:28.420619 dv-cinder-820027-30-smb devstack@keystone.service[81471]: spawned uWSGI worker 2 (pid: 81482, cores: 1) Sep 14 12:45:28.420619 dv-cinder-820027-30-smb devstack@keystone.service[81471]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 14 12:45:32.859268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:45:32.859268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Sep 14 12:45:32.860098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:45:32.860098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: from cryptography.utils import int_from_bytes Sep 14 12:45:32.862228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:45:32.862228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: from cryptography.utils import int_from_bytes Sep 14 12:45:32.862684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 14 12:45:32.862684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: from cryptography.utils import int_from_bytes Sep 14 12:45:32.911455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 12:45:32.911650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 12:45:32.911799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] command line args: [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 12:45:32.912099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 12:45:32.912279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ================================================================================ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 12:45:32.912539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.912784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_dir = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.912971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.913158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] config_source = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.913338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] debug = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.913541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.913808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 14 12:45:32.913882 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 14 12:45:32.913947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.914017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] command line args: [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 14 12:45:32.914082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.914289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 14 12:45:32.914374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.914477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ================================================================================ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 14 12:45:32.914561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.914862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] admin_token = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.914970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.914970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_config_append = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_dir = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_dir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] config_source = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] debug = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.915899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.916986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_config_append = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_dir = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.917972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918509 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.918950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.919201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.919201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.919544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.919704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.919813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] publish_errors = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.919922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.920050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.920174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.920304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.920387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.920574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.920752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.920838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.921033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.921235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] standard_threads = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.921415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.921596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.921678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.921785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.921785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_journal = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_json = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] publish_errors = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_stderr = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] use_syslog = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.922889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.923036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.923036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.923169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.923340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.923469 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.923568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.923656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.923788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] standard_threads = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.923890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.924051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.924209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.924209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.924406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.924482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.924552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.924552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_journal = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.924725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.924795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_json = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.924873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.924944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_stderr = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.925041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] use_syslog = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.925145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.925287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 14 12:45:32.925412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.925556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.925685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.925821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.925913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.926986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.927946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.928947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.929981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.930936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.931911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.932974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.933977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.934984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.935952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.936934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.937937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.938875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939022 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.939992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.940971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.941923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942013 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.942982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943360 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.943933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.944917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.945863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.946958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.947995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.948985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.external = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.949131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.949209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.949374 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.949460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.949613 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.949691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.949865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.950011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.password = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.950087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] auth.token = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.950158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.951227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.951325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.951499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.951647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.951771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.951971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.external = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.952118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.952236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.952540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.952607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.952777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.password = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] auth.token = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.953977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.954209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.954289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.954457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.954535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.954707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.954792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.954941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955510 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.955934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.956175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.956256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.956442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.956532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.956681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.956761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.956932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957012 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.957964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.958140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.958219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.958406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.958492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.958692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.958771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.958950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.959126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.959205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.959412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.959584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.959654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.959896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.960062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.960154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.960398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.960522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.960641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.960751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.960905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.961029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.961155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.961296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.961414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.961568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.967536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.967639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.967719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.967795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.967965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.968932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969213 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.969946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970016 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.970959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971394 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.971979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.972974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.973975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.974976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.975997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.976997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977249 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.977972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.978952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.979953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.980150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.980295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.980426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.980559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.980687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.980816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.980945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.981039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.981135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.981253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.981371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.981597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.981830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.982994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.983167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.983247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.983407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.983487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.983715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.983811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.983886 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.984930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.985083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.985177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.985366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.985446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.985623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.985711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.985878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.986903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.987880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.988912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.989904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.990075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.990156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.990401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.990516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.990656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.990757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.990909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.991011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.991266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.991352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.991519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.991599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.991771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.991851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.992869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.993833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.994976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.995933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.996937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.997964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.998999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:32.999997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.000200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.000281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.000443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.000526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.000687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.000767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.000924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.001953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.002892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.003851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.004099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.004186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.004260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 12:45:33.004333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.004495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.004736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 14 12:45:33.004909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 14 12:45:33.035573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.035793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.036030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.036124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.036309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.036486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.044638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.045500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.073614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.073826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.074619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.074855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.129677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.129871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.179289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.179464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.180149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.180385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.339212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.339404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.339518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.339602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.339680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.339839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.339931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.340072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.340165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.340294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.340419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.340505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.363832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.363993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364195 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.364973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.365064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.365203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.365291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.377233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.377354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.390773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.390924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.390992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.391985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.392114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.392189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 14 12:45:33.409414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.409600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 12:45:33.409853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.409943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.410067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 12:45:33.410151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 12:45:33.410408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.410489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.410608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 14 12:45:33.410691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.410888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.410970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.411255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.411451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.411531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.411668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.421762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.422032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.422124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.422320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.422405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.422595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.422677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.422940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.430010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.430109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.433330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.433330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.433492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.433573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.433650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.433713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.433774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.433934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.434130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.434225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.434301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.434521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.434648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.435391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.435533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.435706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.435905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.436005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.436245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.436363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.436527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.436615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.459596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.459889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.461163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.461314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.461460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.461548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.466629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.466816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.466915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.467034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.467208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.467296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.473775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.474124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.475984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.476308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.480094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.480359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.480656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.480963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.481250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.482065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.482344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.482622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.482819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.483131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.483423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.483719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.484273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.484385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.484568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.484850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.498958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.499243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.500860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.501245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.503077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.504883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.506283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.506585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.508114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.508419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.510737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.512563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.514049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.515855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.517318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.517622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.517918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.518211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.518492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.518777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.519049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.519354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.519650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.519939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.520248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.520537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.535110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.535415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.535691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.535960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.536851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.537158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.537427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.537693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.542800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.545037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.545209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.546600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.546767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.546899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.548184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.548471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.549553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.549845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.550151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.550450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.550851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.551189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.551484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.551780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.552100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.552503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.562654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.562958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.563250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.563549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.563944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.564261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.564551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.564710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.564879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.565172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.565459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.565856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.566160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.566447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.580037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.582382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.583010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.585409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.585971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.587438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.588339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.588944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.589234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.589664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.589811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.591359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.591643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.592080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.596151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.597653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.598473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.599970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.600561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.600986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.601281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.601565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.602889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.603299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.603593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.603880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.610159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.610467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.610762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.612389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.612699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.612987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.617667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.617959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.618248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.618530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.618808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.619085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.619456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.619653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.619856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 14 12:45:33.619965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.620171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.620280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.620461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.620608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.620745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.620837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.621016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.621107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.621291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.621383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.621569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.621865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.622683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.622970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.623260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.623546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.623881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.624188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 14 12:45:33.658528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9ef12a9c0 pid: 81482 (default app) Sep 14 12:45:33.659369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a9ef12a9c0 pid: 81481 (default app) Sep 14 12:45:33.662053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691e71b-23b2-4902-b591-864b3fa2be45 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:33.662346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691e71b-23b2-4902-b591-864b3fa2be45 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:33.662622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691e71b-23b2-4902-b591-864b3fa2be45 None None] PATH_INFO: `/v3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:33.666790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Wed Sep 14 12:45:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:40.750670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824c96-36c1-47b7-be19-30f5b7d0ab98 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:40.751260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824c96-36c1-47b7-be19-30f5b7d0ab98 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:40.751260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66824c96-36c1-47b7-be19-30f5b7d0ab98 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:40.755481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:45:40.763377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:40.764323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:40.764496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:40.837334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: INFO dbcounter [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] Registered counter for database keystone Sep 14 12:45:40.856999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG oslo_db.sqlalchemy.engines [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:45:40.863643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writer thread running {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:45:41.057371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG passlib.handlers.bcrypt [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81482) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 12:45:41.057767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG passlib.handlers.bcrypt [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81482) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 12:45:41.118928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:41.120610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:41.273599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 14 12:45:41.723764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824c96-36c1-47b7-be19-30f5b7d0ab98 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:41.794514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: INFO dbcounter [None req-66824c96-36c1-47b7-be19-30f5b7d0ab98 None None] Registered counter for database keystone Sep 14 12:45:41.818076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG oslo_db.sqlalchemy.engines [None req-66824c96-36c1-47b7-be19-30f5b7d0ab98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 14 12:45:41.824714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writer thread running {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 14 12:45:41.951483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66824c96-36c1-47b7-be19-30f5b7d0ab98 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:41.955857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720399b-7237-46c2-ac3b-4a95896b193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:41.956523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720399b-7237-46c2-ac3b-4a95896b193c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:41.956799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720399b-7237-46c2-ac3b-4a95896b193c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:41.957076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720399b-7237-46c2-ac3b-4a95896b193c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:41.966656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720399b-7237-46c2-ac3b-4a95896b193c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:42.019625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3720399b-7237-46c2-ac3b-4a95896b193c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 12:45:42.019956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720399b-7237-46c2-ac3b-4a95896b193c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:42.031924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Sep 14 12:45:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 12:45:42.037954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:42.055332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b381b-9c88-484a-97f8-2a2f63ad392d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:42.060807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87365786-6171-44c0-8720-153ad3dd62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:42.061929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365786-6171-44c0-8720-153ad3dd62bf admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:42.062209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365786-6171-44c0-8720-153ad3dd62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:42.062480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87365786-6171-44c0-8720-153ad3dd62bf admin admin] PATH_INFO: `/v3/projects/aef2b4eee2a24765906ec0ab593443d9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:42.064150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365786-6171-44c0-8720-153ad3dd62bf admin admin] RBAC: Authorizing `identity:get_project(project_id=aef2b4eee2a24765906ec0ab593443d9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:42.126157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING keystone.common.rbac_enforcer.enforcer [None req-87365786-6171-44c0-8720-153ad3dd62bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 14 12:45:42.126657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87365786-6171-44c0-8720-153ad3dd62bf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:42.131640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Sep 14 12:45:42 2022] GET /identity/v3/projects/aef2b4eee2a24765906ec0ab593443d9 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:44.345795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f204-59ad-4a43-96bd-5f45e2613fd5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:44.346372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f204-59ad-4a43-96bd-5f45e2613fd5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:44.346372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f204-59ad-4a43-96bd-5f45e2613fd5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:44.350686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:45:44.357582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d795b-7e2d-4c78-98b0-afdee18dc951 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:44.358176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d795b-7e2d-4c78-98b0-afdee18dc951 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:44.358176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d795b-7e2d-4c78-98b0-afdee18dc951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:44.379523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-be5d795b-7e2d-4c78-98b0-afdee18dc951 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:44.381134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-be5d795b-7e2d-4c78-98b0-afdee18dc951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:44.389564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 14 12:45:44.664007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543f204-59ad-4a43-96bd-5f45e2613fd5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:44.677674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543f204-59ad-4a43-96bd-5f45e2613fd5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:44.682296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54193e03-d8aa-4bb0-8099-bb0ca65d8cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:44.682917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193e03-d8aa-4bb0-8099-bb0ca65d8cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:44.683194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193e03-d8aa-4bb0-8099-bb0ca65d8cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:44.683465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54193e03-d8aa-4bb0-8099-bb0ca65d8cc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:44.692552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54193e03-d8aa-4bb0-8099-bb0ca65d8cc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:44.694351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54193e03-d8aa-4bb0-8099-bb0ca65d8cc2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:44.705295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Sep 14 12:45:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 12:45:44.711697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d795b-7e2d-4c78-98b0-afdee18dc951 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:44.726992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d795b-7e2d-4c78-98b0-afdee18dc951 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:44.734300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198debb8-6716-4891-b1df-789372595c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:44.735398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198debb8-6716-4891-b1df-789372595c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:44.735912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198debb8-6716-4891-b1df-789372595c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:44.736467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198debb8-6716-4891-b1df-789372595c80 admin admin] PATH_INFO: `/v3/users/4b5c40417fe143e3b4a100405e55b647` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:44.738921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198debb8-6716-4891-b1df-789372595c80 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b5c40417fe143e3b4a100405e55b647)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:44.742629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198debb8-6716-4891-b1df-789372595c80 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:44.745700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Wed Sep 14 12:45:44 2022] GET /identity/v3/users/4b5c40417fe143e3b4a100405e55b647 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:47.128628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5501-6225-4005-803f-0c30917897e3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:47.129329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5501-6225-4005-803f-0c30917897e3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:47.129579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5501-6225-4005-803f-0c30917897e3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:47.131436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:47.138371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320079d3-9fff-4b43-a9e9-35779defa605 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:47.139206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320079d3-9fff-4b43-a9e9-35779defa605 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:47.139363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320079d3-9fff-4b43-a9e9-35779defa605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:47.146573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ceaf-eaa3-46d0-891b-63f8d1f8bad6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:47.147161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ceaf-eaa3-46d0-891b-63f8d1f8bad6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:47.147670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7ceaf-eaa3-46d0-891b-63f8d1f8bad6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:47.149830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:45:47.157201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bba89-7495-4841-8812-86273dddd447 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:47.157465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bba89-7495-4841-8812-86273dddd447 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:47.157736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bba89-7495-4841-8812-86273dddd447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:47.161642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-320079d3-9fff-4b43-a9e9-35779defa605 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:47.162862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-320079d3-9fff-4b43-a9e9-35779defa605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:47.206905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-668bba89-7495-4841-8812-86273dddd447 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81481) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 14 12:45:47.207303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG passlib.handlers.bcrypt [None req-668bba89-7495-4841-8812-86273dddd447 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81481) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 14 12:45:47.257905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-668bba89-7495-4841-8812-86273dddd447 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:47.259546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-668bba89-7495-4841-8812-86273dddd447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:47.299860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:47.387211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:45:47.572805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320079d3-9fff-4b43-a9e9-35779defa605 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:47.608411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:47.664921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bba89-7495-4841-8812-86273dddd447 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:47.720433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320079d3-9fff-4b43-a9e9-35779defa605 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:47.758959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:47.759573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:47.759853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:47.760154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:47.837658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:47.839175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:47.849342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bba89-7495-4841-8812-86273dddd447 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:47.853504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:47.865037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:47.904031 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:47.905182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:47.905460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:47.905732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:47.919094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:45:47.927601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:45:47.928672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:45:47.929511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 8/14] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:45:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:45:47.935449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:47.962108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 7/15] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:45:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:45:47.968580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:48.056507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b5e50-6646-4792-bf45-84106cb5d079 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:48.086295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07335f03-3aaf-4210-b0d0-804ffa10625f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:48.094761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:48.095382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:48.095661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:48.095938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:48.096651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:45:48.096959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:48.098466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:48.111226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:48.112364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 9/16] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:45:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:48.118413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:48.125474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:48.126131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:48.126413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:48.126683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:48.139506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:48.141070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:45:48.162317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:45:48.163300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:45:48.164132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:45:48.164132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:45:48.164132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:45:48.164132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 8/17] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:45:48.167299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:48.171278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:48.262444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00babfd-6a38-4cc3-9252-b17f2ae8f6f3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:48.287814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e518f-98a9-49d6-912e-a4cf207807a3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:48.313138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:48.314132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:48.314132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:48.314369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] PATH_INFO: `/v3/users/4b5c40417fe143e3b4a100405e55b647` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:48.315970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] RBAC: Authorizing `identity:get_user(user_id=4b5c40417fe143e3b4a100405e55b647)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:48.317488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:48.319173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 10/18] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:45:48 2022] GET /identity/v3/users/4b5c40417fe143e3b4a100405e55b647 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:48.325129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:48.335031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:48.335674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:48.335954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:48.336274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:48.336952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:45:48.337255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:48.338725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:48.360217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 9/19] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:48.451138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:48.460244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e164b-e4f3-47a7-8ff2-12dfade1f240 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:48.506034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5e720-2e71-452e-b3cd-cf15d2609cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:48.506700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5e720-2e71-452e-b3cd-cf15d2609cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:48.506977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5e720-2e71-452e-b3cd-cf15d2609cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:48.507252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5e720-2e71-452e-b3cd-cf15d2609cf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:48.508615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5e720-2e71-452e-b3cd-cf15d2609cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:48.510155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5e720-2e71-452e-b3cd-cf15d2609cf9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:48.511871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 11/20] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:45:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:48.519208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:48.580756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:48.676616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ea6bd-ba79-4297-92e8-1ecf16adfb55 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:48.738842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ab23-90f7-49e5-8cc4-abd5fb3032ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:48.739482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ab23-90f7-49e5-8cc4-abd5fb3032ff None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:48.739810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ab23-90f7-49e5-8cc4-abd5fb3032ff None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:48.740222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ab23-90f7-49e5-8cc4-abd5fb3032ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:48.741073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9ab23-90f7-49e5-8cc4-abd5fb3032ff None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.domain.id=default, user.id=4b5c40417fe143e3b4a100405e55b647) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:45:48.741416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9ab23-90f7-49e5-8cc4-abd5fb3032ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:48.743646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9ab23-90f7-49e5-8cc4-abd5fb3032ff None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:48.756627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 10/21] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Sep 14 12:45:48 2022] GET /identity/v3/role_assignments?user.id=4b5c40417fe143e3b4a100405e55b647&scope.domain.id=default&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 233 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:51.966604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3637a72-24e4-4549-8ffa-500d5bbdf24b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:51.968194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3637a72-24e4-4549-8ffa-500d5bbdf24b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:51.968985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3637a72-24e4-4549-8ffa-500d5bbdf24b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:51.971759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 12/22] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:51.987459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044397c-a80b-465b-86e6-6044bc68e3e6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:51.988980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044397c-a80b-465b-86e6-6044bc68e3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:51.989725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044397c-a80b-465b-86e6-6044bc68e3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:52.033796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2044397c-a80b-465b-86e6-6044bc68e3e6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:52.036375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2044397c-a80b-465b-86e6-6044bc68e3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:52.220181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 11/23] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:52.415705 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced14-861b-4907-8afc-711d99125927 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:52.416728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced14-861b-4907-8afc-711d99125927 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:52.417507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cced14-861b-4907-8afc-711d99125927 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:52.420936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:52.430384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e680a-9740-4ec8-b191-d870cbb4af15 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:52.431308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e680a-9740-4ec8-b191-d870cbb4af15 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:52.432083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e680a-9740-4ec8-b191-d870cbb4af15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:52.469864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-396e680a-9740-4ec8-b191-d870cbb4af15 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:52.472450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-396e680a-9740-4ec8-b191-d870cbb4af15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:52.529313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:52.587652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07e13b-1ba8-481c-8eca-cec306b5788a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:52.588182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07e13b-1ba8-481c-8eca-cec306b5788a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:52.588669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07e13b-1ba8-481c-8eca-cec306b5788a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:52.591570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 14/25] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:45:52.598181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6e1c-7a6e-49df-ada2-899f95fc3399 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:52.598657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6e1c-7a6e-49df-ada2-899f95fc3399 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:52.599131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c6e1c-7a6e-49df-ada2-899f95fc3399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:52.686501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-411c6e1c-7a6e-49df-ada2-899f95fc3399 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:52.688575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-411c6e1c-7a6e-49df-ada2-899f95fc3399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:52.707671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 12/26] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:52.853638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 15/27] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:45:52.909209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb9b6-03e0-465b-8b42-079fde0f1657 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:52.909693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb9b6-03e0-465b-8b42-079fde0f1657 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:52.910180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb9b6-03e0-465b-8b42-079fde0f1657 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:52.912863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 13/28] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:52.920555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5bd7-eb4b-4cf8-a77b-f0ec3e59b22b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:52.921043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5bd7-eb4b-4cf8-a77b-f0ec3e59b22b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:52.921514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5bd7-eb4b-4cf8-a77b-f0ec3e59b22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:52.932184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcb9b6-03e0-465b-8b42-079fde0f1657 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:52.955378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8d1e5bd7-eb4b-4cf8-a77b-f0ec3e59b22b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:52.957004 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8d1e5bd7-eb4b-4cf8-a77b-f0ec3e59b22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:53.173808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 16/29] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:53.182227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5bd7-eb4b-4cf8-a77b-f0ec3e59b22b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:53.242497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:53.335292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcb9b6-03e0-465b-8b42-079fde0f1657 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:53.420460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:53.421479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:53.422357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:53.423638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:53.424660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:53.427890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:53.438181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5bd7-eb4b-4cf8-a77b-f0ec3e59b22b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:53.524901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:53.525865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:53.526296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:53.526711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:53.567345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:45:53.576601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:45:53.577538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:45:53.578318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 17/30] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:45:53.579007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:53.624135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 14/31] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Sep 14 12:45:52 2022] POST /identity/v3/roles => generated 219 bytes in 684 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:45:53.625352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:53.688545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:53.701954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:53.718122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f346-5be1-4def-ac74-46773104de40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:53.760064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:53.761242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:53.761746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:53.762819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:53.787800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:53.789785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:45:53.809877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:45:53.810833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:45:53.811874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:45:53.811874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:45:53.811874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:45:53.811874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 18/32] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:45:53.818081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:53.880292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052ab4-73dc-4b7b-bcca-a2dae400fd5d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:53.941534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988f5a63-21f6-46bc-8f4f-db208fca6812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:53.944373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5a63-21f6-46bc-8f4f-db208fca6812 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:53.945271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5a63-21f6-46bc-8f4f-db208fca6812 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:53.946243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f5a63-21f6-46bc-8f4f-db208fca6812 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:53.949240 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f5a63-21f6-46bc-8f4f-db208fca6812 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:53.953152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988f5a63-21f6-46bc-8f4f-db208fca6812 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:53.971816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9184-706e-4ff7-b83f-15187a1ddd01 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:53.975987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 15/33] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Sep 14 12:45:53 2022] POST /identity/v3/roles => generated 225 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:45:53.982137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c6590-0864-487c-a9ef-0c6953a608dc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:53.982713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c6590-0864-487c-a9ef-0c6953a608dc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:53.982998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c6590-0864-487c-a9ef-0c6953a608dc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:53.997025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 16/34] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:53.997025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c6590-0864-487c-a9ef-0c6953a608dc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.047130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccf4ec4-aa2d-4e56-91e2-041a27a15a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.047841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf4ec4-aa2d-4e56-91e2-041a27a15a37 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.048156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf4ec4-aa2d-4e56-91e2-041a27a15a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.048438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf4ec4-aa2d-4e56-91e2-041a27a15a37 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.049172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf4ec4-aa2d-4e56-91e2-041a27a15a37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:45:54.049548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf4ec4-aa2d-4e56-91e2-041a27a15a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.051227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccf4ec4-aa2d-4e56-91e2-041a27a15a37 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:54.053533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:54.065906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 19/35] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:54.072298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3caceb-c211-4d04-8fa6-783deff45607 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.072558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3caceb-c211-4d04-8fa6-783deff45607 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.072910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3caceb-c211-4d04-8fa6-783deff45607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.097209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0f3caceb-c211-4d04-8fa6-783deff45607 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:54.099208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f3caceb-c211-4d04-8fa6-783deff45607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:54.178851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:54.198939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 20/36] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:54.201756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3caceb-c211-4d04-8fa6-783deff45607 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.216419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c6590-0864-487c-a9ef-0c6953a608dc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:54.260208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.260892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.261182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.261459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.262225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:45:54.262713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.264370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:54.278500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 17/37] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:54.285626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.330621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3caceb-c211-4d04-8fa6-783deff45607 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:54.363166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:54.375081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b587045-ca31-439e-a78d-3dbf6043df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.375733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587045-ca31-439e-a78d-3dbf6043df6f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.376060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587045-ca31-439e-a78d-3dbf6043df6f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.376327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b587045-ca31-439e-a78d-3dbf6043df6f None admin] PATH_INFO: `/v3/users/4b5c40417fe143e3b4a100405e55b647` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.377542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b587045-ca31-439e-a78d-3dbf6043df6f None admin] RBAC: Authorizing `identity:get_user(user_id=4b5c40417fe143e3b4a100405e55b647)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.379060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b587045-ca31-439e-a78d-3dbf6043df6f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:54.380713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 21/38] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:45:54 2022] GET /identity/v3/users/4b5c40417fe143e3b4a100405e55b647 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:54.382036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a918-3a2a-4a04-84dd-435eaf35a867 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.382317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a918-3a2a-4a04-84dd-435eaf35a867 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.382593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033a918-3a2a-4a04-84dd-435eaf35a867 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.384297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 22/39] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:54.389238 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a918-3a2a-4a04-84dd-435eaf35a867 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.411611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1e17-832d-4422-ad19-8097daeae895 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:54.463311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d5b5d-4536-4e63-92e0-774909e5cff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.463865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d5b5d-4536-4e63-92e0-774909e5cff8 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.464184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d5b5d-4536-4e63-92e0-774909e5cff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.464464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d5b5d-4536-4e63-92e0-774909e5cff8 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.465147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d5b5d-4536-4e63-92e0-774909e5cff8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.467356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d5b5d-4536-4e63-92e0-774909e5cff8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:54.479620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:54.508063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 18/40] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:45:54 2022] POST /identity/v3/projects => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:45:54.508768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67b1f9-47d0-4658-96c4-4108dcd30679 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.509244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67b1f9-47d0-4658-96c4-4108dcd30679 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.509720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67b1f9-47d0-4658-96c4-4108dcd30679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.531785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3d67b1f9-47d0-4658-96c4-4108dcd30679 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:54.533420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3d67b1f9-47d0-4658-96c4-4108dcd30679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:54.535239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033a918-3a2a-4a04-84dd-435eaf35a867 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:54.575831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.576508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.576791 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.577054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.578241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.579718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:54.581374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 23/41] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:45:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:54.582190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.623850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 19/42] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:54.625057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67b1f9-47d0-4658-96c4-4108dcd30679 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.680621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:54.733200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbe4c1-e5d1-4d00-abec-49d29e6fe9b9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:54.771138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67b1f9-47d0-4658-96c4-4108dcd30679 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:54.776154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.777028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.777921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.778326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.779618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.781151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:54.782914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 24/43] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:45:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:54.788986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.905587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:54.922049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db83b0-9dd5-4b67-8742-cf9828cbecc4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:54.925158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.925841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.926115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.926386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] PATH_INFO: `/v3/domains/default/users/4b5c40417fe143e3b4a100405e55b647/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.928338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4b5c40417fe143e3b4a100405e55b647, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.929810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:54.945404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 20/44] 10.222.0.50 () {58 vars in 1361 bytes} [Wed Sep 14 12:45:54 2022] PUT /identity/v3/domains/default/users/4b5c40417fe143e3b4a100405e55b647/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:45:54.946284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:54.958695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:54.969260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e1214-d557-4666-a518-07518748b19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:54.970201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e1214-d557-4666-a518-07518748b19f None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:54.970484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e1214-d557-4666-a518-07518748b19f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:54.970779 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e1214-d557-4666-a518-07518748b19f None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:54.971958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e1214-d557-4666-a518-07518748b19f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:54.973527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e1214-d557-4666-a518-07518748b19f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:55.074369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f8b58-8a20-4997-a7eb-ff9ea4f91f5f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:55.117568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956e69e-7d7b-46f7-bb9f-7e5cea247533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:55.118195 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e69e-7d7b-46f7-bb9f-7e5cea247533 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:55.118475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e69e-7d7b-46f7-bb9f-7e5cea247533 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:55.118767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956e69e-7d7b-46f7-bb9f-7e5cea247533 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:55.119463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956e69e-7d7b-46f7-bb9f-7e5cea247533 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:55.121107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956e69e-7d7b-46f7-bb9f-7e5cea247533 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:55.124993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 25/45] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:45:54 2022] POST /identity/v3/projects => generated 312 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:45:55.145295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 21/46] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Sep 14 12:45:54 2022] POST /identity/v3/roles => generated 223 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:45:57.291797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1559-7f63-48a0-ac3c-8af40918e73d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:57.292367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1559-7f63-48a0-ac3c-8af40918e73d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:57.292502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e1559-7f63-48a0-ac3c-8af40918e73d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:57.293893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 26/47] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:57.303258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38625a-40d2-4aff-b394-447b7ee87cae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:57.303802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38625a-40d2-4aff-b394-447b7ee87cae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:57.304244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38625a-40d2-4aff-b394-447b7ee87cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:57.335958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1d38625a-40d2-4aff-b394-447b7ee87cae None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:57.338364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1d38625a-40d2-4aff-b394-447b7ee87cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:57.392040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:57.431797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 22/48] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:57.452700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb3abb-bb13-43a1-806f-ab80e35c8667 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:57.453165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb3abb-bb13-43a1-806f-ab80e35c8667 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:57.453575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb3abb-bb13-43a1-806f-ab80e35c8667 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:57.455097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 27/49] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:45:57.460996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977565-faad-4987-b5e3-5a16f9412c73 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:57.461288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977565-faad-4987-b5e3-5a16f9412c73 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:57.461567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef977565-faad-4987-b5e3-5a16f9412c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:57.482750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ef977565-faad-4987-b5e3-5a16f9412c73 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:45:57.483969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ef977565-faad-4987-b5e3-5a16f9412c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:45:57.571090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 23/50] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:45:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:45:57.710025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb3abb-bb13-43a1-806f-ab80e35c8667 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:57.825167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb3abb-bb13-43a1-806f-ab80e35c8667 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:57.854022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef977565-faad-4987-b5e3-5a16f9412c73 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:57.866622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:57.867279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:57.867563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:57.867838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:57.880816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:45:57.885963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:45:57.887158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:45:57.888039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 28/51] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:45:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:45:57.894372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:57.953264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:57.987622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:57.991356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef977565-faad-4987-b5e3-5a16f9412c73 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:58.025214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5f8ac-3a6e-4136-9c65-aef79ef524c0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:58.034514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:58.035171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:58.035452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:58.035736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:58.036953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:58.038452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:58.040112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 24/52] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:45:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:58.047365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:58.066470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:58.067094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:58.067376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:58.067650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:58.068486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:45:58.068795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:58.070362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:58.080814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 29/53] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:45:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:58.086840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:58.177707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f7bec-4c91-4cc9-93ab-a02d7ffb4dcc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:58.215859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:58.217179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:58.217465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:58.217739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:58.218433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:58.219947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:58.221837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc649-5f2c-44db-b495-59c9b2107d71 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:58.226191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:58.260323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 25/54] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Sep 14 12:45:58 2022] POST /identity/v3/projects => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:45:58.264372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:58.265071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:58.265304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:58.265584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] PATH_INFO: `/v3/users/4b5c40417fe143e3b4a100405e55b647` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:58.266949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=4b5c40417fe143e3b4a100405e55b647)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:58.268505 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:58.270202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 30/55] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:45:58 2022] GET /identity/v3/users/4b5c40417fe143e3b4a100405e55b647 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:45:58.276154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:58.311553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:45:58.418095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2f299-6d9c-40da-a7d4-cd89652f0443 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:58.462471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1b21-6d80-4d20-8b01-8228bb01626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:58.463142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1b21-6d80-4d20-8b01-8228bb01626f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:58.463428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1b21-6d80-4d20-8b01-8228bb01626f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:58.463705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1b21-6d80-4d20-8b01-8228bb01626f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:58.465053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1b21-6d80-4d20-8b01-8228bb01626f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:58.467837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1b21-6d80-4d20-8b01-8228bb01626f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:58.469629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 26/56] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:45:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:45:58.475842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:45:58.706407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5dab7-2b9f-47b2-bab6-1c9367e90eb3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:45:58.745502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd780b5-4a05-4536-8525-3eebcf296352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:45:58.746127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd780b5-4a05-4536-8525-3eebcf296352 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:45:58.746966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd780b5-4a05-4536-8525-3eebcf296352 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:45:58.747250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd780b5-4a05-4536-8525-3eebcf296352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:45:58.747990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd780b5-4a05-4536-8525-3eebcf296352 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.domain.id=default, user.id=4b5c40417fe143e3b4a100405e55b647) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:45:58.748342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd780b5-4a05-4536-8525-3eebcf296352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:45:58.749805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd780b5-4a05-4536-8525-3eebcf296352 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:45:58.760419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 31/57] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Sep 14 12:45:58 2022] GET /identity/v3/role_assignments?user.id=4b5c40417fe143e3b4a100405e55b647&scope.domain.id=default&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 530 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:00.574265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2297a3-7363-4ca6-9076-3058383610c5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:00.575299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2297a3-7363-4ca6-9076-3058383610c5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:00.575561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2297a3-7363-4ca6-9076-3058383610c5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:00.577021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 27/58] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:00.582817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3252b-53fa-400c-aef3-70ab5b57a8e2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:00.583296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3252b-53fa-400c-aef3-70ab5b57a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:00.583379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3252b-53fa-400c-aef3-70ab5b57a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:00.602792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-80a3252b-53fa-400c-aef3-70ab5b57a8e2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:00.604857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-80a3252b-53fa-400c-aef3-70ab5b57a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:00.639657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:00.682926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 32/59] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:00.956097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2297a3-7363-4ca6-9076-3058383610c5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:01.054065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:01.067878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2297a3-7363-4ca6-9076-3058383610c5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:01.103583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f42c5-4206-472e-816d-ab70e13138ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:01.104252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f42c5-4206-472e-816d-ab70e13138ab None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:01.104535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f42c5-4206-472e-816d-ab70e13138ab None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:01.104811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f42c5-4206-472e-816d-ab70e13138ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:01.106637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f42c5-4206-472e-816d-ab70e13138ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:01.108339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f42c5-4206-472e-816d-ab70e13138ab None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:01.109925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 28/60] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:01.115489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3252b-53fa-400c-aef3-70ab5b57a8e2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:01.221846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3252b-53fa-400c-aef3-70ab5b57a8e2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:01.255370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c14ffb-177b-41a0-a4b8-46f846c5f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:01.255981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c14ffb-177b-41a0-a4b8-46f846c5f7fb None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:01.256315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c14ffb-177b-41a0-a4b8-46f846c5f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:01.256588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c14ffb-177b-41a0-a4b8-46f846c5f7fb None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:01.257257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c14ffb-177b-41a0-a4b8-46f846c5f7fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:01.258715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c14ffb-177b-41a0-a4b8-46f846c5f7fb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:01.289297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 33/61] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:46:01 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:04.712049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a473-7887-48ee-bca0-c0ffa65ca0ed None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:04.713039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a473-7887-48ee-bca0-c0ffa65ca0ed None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:04.724130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631a473-7887-48ee-bca0-c0ffa65ca0ed None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:04.726085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 29/62] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:04 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:04.734632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d30ea3-363e-4000-89d1-73f4bf26703a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:04.735762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d30ea3-363e-4000-89d1-73f4bf26703a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:04.736484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d30ea3-363e-4000-89d1-73f4bf26703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:04.769361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-49d30ea3-363e-4000-89d1-73f4bf26703a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:04.770943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-49d30ea3-363e-4000-89d1-73f4bf26703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:04.795739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:04.889189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 34/63] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:05.008466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfec7-69df-413a-8693-e1946d791e8b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.008872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfec7-69df-413a-8693-e1946d791e8b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.009015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dfec7-69df-413a-8693-e1946d791e8b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.010626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 30/64] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:05.016954 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e448ab-00bc-4ce3-858b-058b1514ac8b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.017246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e448ab-00bc-4ce3-858b-058b1514ac8b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.017549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e448ab-00bc-4ce3-858b-058b1514ac8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.049137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d0e448ab-00bc-4ce3-858b-058b1514ac8b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:05.050364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d0e448ab-00bc-4ce3-858b-058b1514ac8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:05.168764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 35/65] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:05.275642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dfec7-69df-413a-8693-e1946d791e8b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:05.387179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea808ae-79e0-4df7-919e-fb6f2f209d20 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.387696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea808ae-79e0-4df7-919e-fb6f2f209d20 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.388171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea808ae-79e0-4df7-919e-fb6f2f209d20 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.389682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 36/66] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:05.395752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aab1f-0203-4f1b-8b9c-da3e158dff6c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.396261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aab1f-0203-4f1b-8b9c-da3e158dff6c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.396681 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7aab1f-0203-4f1b-8b9c-da3e158dff6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.435025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cd7aab1f-0203-4f1b-8b9c-da3e158dff6c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:05.436272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cd7aab1f-0203-4f1b-8b9c-da3e158dff6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:05.451863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dfec7-69df-413a-8693-e1946d791e8b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:05.519663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:05.520305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 37/67] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:05.520742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.521265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.521766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.521878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d85373-4982-4b02-af9f-5b6ed57f51a5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.524498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d85373-4982-4b02-af9f-5b6ed57f51a5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.526478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d85373-4982-4b02-af9f-5b6ed57f51a5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.530550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 38/68] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:05.541350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34d85-1cb2-4b79-aa83-beb2551c1c0b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.541889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34d85-1cb2-4b79-aa83-beb2551c1c0b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.542348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc34d85-1cb2-4b79-aa83-beb2551c1c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.544595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:05.551203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:05.552332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:05.553319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:05.556046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 31/69] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:05.563415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:05.575577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bfc34d85-1cb2-4b79-aa83-beb2551c1c0b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:05.576881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bfc34d85-1cb2-4b79-aa83-beb2551c1c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:05.586269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:05.598033 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:05.666345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 39/70] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:05.667698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34d85-1cb2-4b79-aa83-beb2551c1c0b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:05.726271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fc7b7-f5ef-407d-991d-79ca78e95c75 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:05.780734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee3dea-a903-4e06-b156-8e4d607694c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:05.781517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3dea-a903-4e06-b156-8e4d607694c8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.782221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3dea-a903-4e06-b156-8e4d607694c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.782719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee3dea-a903-4e06-b156-8e4d607694c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.783791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3dea-a903-4e06-b156-8e4d607694c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:05.784283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3dea-a903-4e06-b156-8e4d607694c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:05.786641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee3dea-a903-4e06-b156-8e4d607694c8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:05.804029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 32/71] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:05.808349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc34d85-1cb2-4b79-aa83-beb2551c1c0b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:05.809967 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac04a7-d934-4ba8-8155-648ad8f2df39 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.810491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac04a7-d934-4ba8-8155-648ad8f2df39 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.811017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac04a7-d934-4ba8-8155-648ad8f2df39 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.812786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 33/72] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:05.817064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac04a7-d934-4ba8-8155-648ad8f2df39 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:05.859586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118d1c-23b3-4e05-a726-0bf0142c9c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:05.860267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118d1c-23b3-4e05-a726-0bf0142c9c73 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.860550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118d1c-23b3-4e05-a726-0bf0142c9c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.860822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118d1c-23b3-4e05-a726-0bf0142c9c73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.872186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16118d1c-23b3-4e05-a726-0bf0142c9c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-16118d1c-23b3-4e05-a726-0bf0142c9c73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:05.877040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:05.877969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 40/73] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:05.883855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb74d5-d391-42d3-85f2-881fae49cdef None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.884765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb74d5-d391-42d3-85f2-881fae49cdef None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.884765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb74d5-d391-42d3-85f2-881fae49cdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.888858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:05.902109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-02fb74d5-d391-42d3-85f2-881fae49cdef None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:05.904348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02fb74d5-d391-42d3-85f2-881fae49cdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:05.919555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:05.945782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac04a7-d934-4ba8-8155-648ad8f2df39 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:05.974384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 41/74] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:05.975236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb74d5-d391-42d3-85f2-881fae49cdef None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:05.983784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:05.984281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:05.984566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:05.984841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:05.998988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.000504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.006645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 34/75] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:05 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:06.006645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.091812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb74d5-d391-42d3-85f2-881fae49cdef None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.116596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fa7f1-1ed6-49b5-9d4f-1b122e6318c0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.124860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.131671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.132347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.132634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.132906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.145567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:06.150476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:06.151325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:06.152139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 42/76] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:06.153069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.162610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.163259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.163544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.163843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.164555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:06.164893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.166245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.168945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.176781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 35/77] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:06.182077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.268403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34a04d-bd10-431c-95f6-27e2f0d6b8b4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.290740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b05579-64b2-455e-acf2-1a9e6e1b2d36 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.302813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.303449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.303729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.304004 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.315070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:06.320427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:06.321326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:06.322127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 43/78] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:06.322771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.327958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.328640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.328927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.329230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.384824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.419044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.423291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.425520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.439190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63275cc0-2497-4c52-aafa-a6b6201073c3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.474833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.475455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.475787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.476098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.476789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:06.477729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.478512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.487690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 44/79] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:06.488571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.545651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 36/80] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:06.545651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.602278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0c92fb-7fa3-4f79-9475-703b9dbc2211 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.616520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.638846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.639490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.639774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.640079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] PATH_INFO: `/v3/users/4b5c40417fe143e3b4a100405e55b647` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.640768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.641244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] RBAC: Authorizing `identity:get_user(user_id=4b5c40417fe143e3b4a100405e55b647)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.642770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.644549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 45/81] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/users/4b5c40417fe143e3b4a100405e55b647 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:06.645117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.645312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e37d32-d7d0-4f60-82df-9de2bfba46de None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.682227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.682858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.683139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.683413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.685159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.686606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.688177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 37/82] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:06.688934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.750486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2261937-2533-4557-a6f8-9b59af23df68 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.785860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.786925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.787377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.787833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.788568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:06.788878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.790252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.796943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8067-1269-4b3b-9890-e7b693b9059a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.801524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 46/83] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:06.802239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.834822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.835471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.835777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.836081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.837246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.838719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.840956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 38/84] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:06.845756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.852231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.879429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:06.912947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b21c9-063c-4c60-9290-cb6a5d0beef5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.948110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.948741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.948927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d6b32-11ff-41a3-816a-ef2b04bbbc21 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:06.949030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.949314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:06.950449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:06.951924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:06.953855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 47/85] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:06.954390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:06.983917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:06.984558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:06.984847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:06.985127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.060123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.061520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:07.063977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e08bc-9565-481e-adc7-7ce2bcfd5d2e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:07.076914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:07.094800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:07.098910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:07.099524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:07.099802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:07.100111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.100941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.102212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:07.124617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 48/86] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:46:06 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:07.133370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:07.172669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 39/87] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:07.172669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:07.283682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a05cfc-2804-4679-9f39-d439369c7654 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:07.294048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b7643-7a0c-4e9e-a7bc-a3c86825bb2c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:07.333214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:07.334199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:07.334661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:07.335477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.336482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.337941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:07.339099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:07.339735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 49/88] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:07 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:07.339928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:07.340627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:07.341034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.341353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:07.344091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:07.383113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:07.431512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.433893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:07.472461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8b9a-53d8-4f97-a908-92cb891a0da5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:07.515122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:07.515733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:07.516050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:07.516319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.517051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=90a2d633b13745feaca9fcbc613a1b38) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:07.517362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.518788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:07.525472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 50/89] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:07 2022] GET /identity/v3/role_assignments?user.id=90a2d633b13745feaca9fcbc613a1b38&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:07.526708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:07.585324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 40/90] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:07.586573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:07.639362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:07.676892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:07.680453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6ebe-4eed-46dd-acab-b18e7cd83120 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:07.736573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:07.737638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:07.738166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:07.738652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.741564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.743885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:07.751395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 51/91] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:07 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:07.751395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:07.778753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c055e9-606c-4a6e-a747-60d1325bee9b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:07.817190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:07.818604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:07.819114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:07.819588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.872992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93cc41-945c-4637-af14-7b1159c41cf1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:07.913831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:07.914483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:07.914770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:07.915048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] PATH_INFO: `/v3/projects/0abaff425fbb406aaa9d01b85e815ad1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:07.916649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=0abaff425fbb406aaa9d01b85e815ad1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.918868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:07.920717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 52/92] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:07 2022] GET /identity/v3/projects/0abaff425fbb406aaa9d01b85e815ad1 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:07.921600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:07.961282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:07.977826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:07.979322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:08.032906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976499c-6848-477b-b0e7-de4db039b7b3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:08.070193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:08.070813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:08.071097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:08.071376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:08.072133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=4b5c40417fe143e3b4a100405e55b647) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:08.072451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:08.074532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:08.080513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 53/93] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:07 2022] GET /identity/v3/role_assignments?user.id=4b5c40417fe143e3b4a100405e55b647&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:08.081351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:08.085994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:08.197051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 41/94] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:08.204052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:08.260183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:08.266110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791c93f-435e-481f-8fd4-6323ff260b4f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:08.339414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:08.341822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:08.341822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:08.341822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:08.342205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=0abaff425fbb406aaa9d01b85e815ad1, user.id=90a2d633b13745feaca9fcbc613a1b38) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:08.342517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:08.344247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:08.351138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 54/95] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:08 2022] GET /identity/v3/role_assignments?user.id=90a2d633b13745feaca9fcbc613a1b38&scope.project.id=0abaff425fbb406aaa9d01b85e815ad1&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:08.407136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13654c3b-e3f0-4567-862e-b9aff02689e1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:08.463856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364ab5f5-fa94-4c8f-b62e-5cbdc98cf72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:08.464451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab5f5-fa94-4c8f-b62e-5cbdc98cf72e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:08.465561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab5f5-fa94-4c8f-b62e-5cbdc98cf72e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:08.465561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364ab5f5-fa94-4c8f-b62e-5cbdc98cf72e None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:08.473008 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ab5f5-fa94-4c8f-b62e-5cbdc98cf72e None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:08.474522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364ab5f5-fa94-4c8f-b62e-5cbdc98cf72e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:08.476636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 42/96] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:08 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:08.483569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:08.649498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9893cac-59fa-456e-b18c-b01b44aa586f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:08.684904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df825a80-0aca-4017-b6c2-1627629fa452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:08.685514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825a80-0aca-4017-b6c2-1627629fa452 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:08.685783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825a80-0aca-4017-b6c2-1627629fa452 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:08.686062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df825a80-0aca-4017-b6c2-1627629fa452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:08.686800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825a80-0aca-4017-b6c2-1627629fa452 None admin] RBAC: Adding query filter params (role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=90a2d633b13745feaca9fcbc613a1b38) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:08.687086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825a80-0aca-4017-b6c2-1627629fa452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:08.688552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df825a80-0aca-4017-b6c2-1627629fa452 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:08.694541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 55/97] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:08 2022] GET /identity/v3/role_assignments?user.id=90a2d633b13745feaca9fcbc613a1b38&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:10.595256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd1a8-8e5a-41f9-a8eb-76d139b1000b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:10.595773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd1a8-8e5a-41f9-a8eb-76d139b1000b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:10.595773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddd1a8-8e5a-41f9-a8eb-76d139b1000b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:10.597174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 43/98] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:10.603543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bfdc3-c1a2-42b9-a9cc-c1e411e6ed47 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:10.604451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bfdc3-c1a2-42b9-a9cc-c1e411e6ed47 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:10.604929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bfdc3-c1a2-42b9-a9cc-c1e411e6ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:10.625405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d62bfdc3-c1a2-42b9-a9cc-c1e411e6ed47 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:10.626896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d62bfdc3-c1a2-42b9-a9cc-c1e411e6ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:10.659775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:10.714069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 56/99] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:10.868096 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0dfad-4639-4c14-b913-41949f5620af None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:10.868708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0dfad-4639-4c14-b913-41949f5620af None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:10.869195 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0dfad-4639-4c14-b913-41949f5620af None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:10.870963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 44/100] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:10.876951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350275-2d55-487b-b234-f78cfff945f0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:10.877520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350275-2d55-487b-b234-f78cfff945f0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:10.877989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94350275-2d55-487b-b234-f78cfff945f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:10.909070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-94350275-2d55-487b-b234-f78cfff945f0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:10.910648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-94350275-2d55-487b-b234-f78cfff945f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:11.005035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 57/101] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:11.036085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc0cca-a553-4671-b539-3abe8c35463c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.036693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc0cca-a553-4671-b539-3abe8c35463c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.037167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc0cca-a553-4671-b539-3abe8c35463c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.039011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 45/102] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:11.045129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b64c4-160d-4063-ace1-03b664ee165f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.045679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b64c4-160d-4063-ace1-03b664ee165f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.046154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b64c4-160d-4063-ace1-03b664ee165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.057162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144add-13b0-4a56-817f-1cfeb40df307 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.057764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144add-13b0-4a56-817f-1cfeb40df307 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.058235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144add-13b0-4a56-817f-1cfeb40df307 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.060331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 46/103] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:46:11.065519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c5f7-1cb5-40d6-8364-8b35fcdec4f1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.066042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c5f7-1cb5-40d6-8364-8b35fcdec4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.066541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124c5f7-1cb5-40d6-8364-8b35fcdec4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.076497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:11.089080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e38b64c4-160d-4063-ace1-03b664ee165f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:11.091494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e38b64c4-160d-4063-ace1-03b664ee165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:11.097243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7124c5f7-1cb5-40d6-8364-8b35fcdec4f1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:11.098417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7124c5f7-1cb5-40d6-8364-8b35fcdec4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:11.226656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 47/104] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:11.228177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124c5f7-1cb5-40d6-8364-8b35fcdec4f1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:11.245052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 58/105] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:11.369130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124c5f7-1cb5-40d6-8364-8b35fcdec4f1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:11.388376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b64c4-160d-4063-ace1-03b664ee165f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:11.421617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:11.425282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:11.435458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:11.436339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.436762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.437179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.451543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:11.457112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:11.457958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:11.458724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:11.461095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 48/106] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:11.467307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:11.590528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b64c4-160d-4063-ace1-03b664ee165f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:11.648267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558c011-9981-40b5-bd8b-504fc8ca7df9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:11.660971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:11.661611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.661919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.662256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.693474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:11.698738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:11.700219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:11.701426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 59/107] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:11.702311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:11.702670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:11.703594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.704121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.704624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.705591 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:11.706103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:11.707936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:11.718357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 49/108] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:11.723923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:11.791347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:11.803490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:11.831782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f3976-7595-49ff-9ecc-e9198a437fda None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:11.856331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb6762-4910-4653-afdf-2e6e3f14e7d9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:11.885770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:11.886521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.886745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.887210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.901273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:11.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:11.907926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:11.908739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 60/109] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:11.909409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:11.911897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:11.912613 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:11.912901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:11.913182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:11.914417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:11.915894 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:11.920148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 50/110] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:11.920148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.034414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246e716-384a-4cce-81e8-5ce702dad278 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.050444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade178d-db3b-4104-93df-36d1f52f6346 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.060415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:12.073334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f4606-8859-4134-b862-dea4331697db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.074003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4606-8859-4134-b862-dea4331697db None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.074328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4606-8859-4134-b862-dea4331697db None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.074624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f4606-8859-4134-b862-dea4331697db None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.075759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f4606-8859-4134-b862-dea4331697db None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.077257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f4606-8859-4134-b862-dea4331697db None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.078846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 51/111] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:11 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:12.079976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cc32b-de5b-4d88-8d07-196387ffa8a3 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.080282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cc32b-de5b-4d88-8d07-196387ffa8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.080552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cc32b-de5b-4d88-8d07-196387ffa8a3 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.084343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 52/112] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:12.084343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cc32b-de5b-4d88-8d07-196387ffa8a3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.094826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.095437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.095721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.096003 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.096713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:12.097018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.098382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.103617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:12.113255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 61/113] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:12.113255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.200759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2cc32b-de5b-4d88-8d07-196387ffa8a3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.226452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db859ee5-8cf5-4084-817f-1d3a0a79dda8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.236178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.236799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.237077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.237434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.238032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:12.238342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.239717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.249907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 53/114] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:12.255132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.263888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137bbe3-d3f4-4b7f-811e-fbe1798c6495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.264634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bbe3-d3f4-4b7f-811e-fbe1798c6495 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.264919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bbe3-d3f4-4b7f-811e-fbe1798c6495 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.265197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bbe3-d3f4-4b7f-811e-fbe1798c6495 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.265853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137bbe3-d3f4-4b7f-811e-fbe1798c6495 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.267293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137bbe3-d3f4-4b7f-811e-fbe1798c6495 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.294270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 62/115] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:46:12 2022] POST /identity/v3/projects => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:12.294270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e792e-51fb-49de-970f-2304186f938e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.294270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e792e-51fb-49de-970f-2304186f938e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.296410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e792e-51fb-49de-970f-2304186f938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.317640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7a0e792e-51fb-49de-970f-2304186f938e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:12.319019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7a0e792e-51fb-49de-970f-2304186f938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:12.321971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:12.389099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:12.389783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37264de0-2f0e-429a-9592-5c665bbded2a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.430150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 63/116] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:12.431948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e792e-51fb-49de-970f-2304186f938e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.437259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.437918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.438215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.438517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.439704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.441725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.444114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 54/117] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:12 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:12.450593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.600170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db2c22-6af1-4b96-b3b5-f98c2694b183 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.600443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e792e-51fb-49de-970f-2304186f938e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.629496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:12.644600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.645675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.646211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.646769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] PATH_INFO: `/v3/users/1a7aad960ec845758deae21a0efc1eb0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.648956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6bcc6-3c80-45f0-9adf-a51cd893ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.649708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6bcc6-3c80-45f0-9adf-a51cd893ed73 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.650070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6bcc6-3c80-45f0-9adf-a51cd893ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.650415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6bcc6-3c80-45f0-9adf-a51cd893ed73 None admin] PATH_INFO: `/v3/users/4b5c40417fe143e3b4a100405e55b647` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.651936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6bcc6-3c80-45f0-9adf-a51cd893ed73 None admin] RBAC: Authorizing `identity:get_user(user_id=4b5c40417fe143e3b4a100405e55b647)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.654791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6bcc6-3c80-45f0-9adf-a51cd893ed73 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.656847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 55/118] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:12 2022] GET /identity/v3/users/4b5c40417fe143e3b4a100405e55b647 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:12.658280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d72ec-4a61-4084-9b47-4a3d870c200e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.659267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d72ec-4a61-4084-9b47-4a3d870c200e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.659626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d72ec-4a61-4084-9b47-4a3d870c200e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.664143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 56/119] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:12.664143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d72ec-4a61-4084-9b47-4a3d870c200e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.673583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] RBAC: Authorizing `identity:get_user(user_id=1a7aad960ec845758deae21a0efc1eb0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.675675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.677688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 64/120] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:12 2022] GET /identity/v3/users/1a7aad960ec845758deae21a0efc1eb0 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:12.678665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.729725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:12.792283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952dc0a-6991-4965-9bff-70e616d8f21b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.793867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d72ec-4a61-4084-9b47-4a3d870c200e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:12.830266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.830928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.831211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.831306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da10df-ff1b-4e5f-95c6-20dce4e0952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:12.831496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/90a2d633b13745feaca9fcbc613a1b38/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.831882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da10df-ff1b-4e5f-95c6-20dce4e0952d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.832191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da10df-ff1b-4e5f-95c6-20dce4e0952d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.832463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da10df-ff1b-4e5f-95c6-20dce4e0952d None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.833550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da10df-ff1b-4e5f-95c6-20dce4e0952d None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.833643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f9f5af9f6441b2a336e4b7e0eee419, user_id=90a2d633b13745feaca9fcbc613a1b38, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:12.835002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.835093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da10df-ff1b-4e5f-95c6-20dce4e0952d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:12.836635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 65/121] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:12 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:12.837728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f37f-da37-464b-8bc6-3644a55ee629 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:12.838006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f37f-da37-464b-8bc6-3644a55ee629 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:12.838274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f37f-da37-464b-8bc6-3644a55ee629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:12.852658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 57/122] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:12 2022] PUT /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/90a2d633b13745feaca9fcbc613a1b38/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:12.853823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:12.865844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-19e9f37f-da37-464b-8bc6-3644a55ee629 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:12.867071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-19e9f37f-da37-464b-8bc6-3644a55ee629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:12.926752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:12.976043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 66/123] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:12.976043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f37f-da37-464b-8bc6-3644a55ee629 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:13.047218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333faad7-86ed-4031-b71e-e82ecca6f337 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:13.050157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:13.124544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:13.125167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:13.125449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:13.125723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:13.148798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f37f-da37-464b-8bc6-3644a55ee629 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:13.217638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:13.220104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:13.220666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:13.221089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:13.244098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:13.255404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:13.256344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:13.257091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:13.262301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 67/124] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:13.262301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:13.270012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:13.272435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:13.337784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:13.386055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:13.389939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2832a3-059f-42ff-a1a6-6a2c42a8693e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:13.401532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 58/125] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:13.403150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:13.438299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:13.439452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:13.439847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:13.440423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/4b5c40417fe143e3b4a100405e55b647/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:13.442558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f9f5af9f6441b2a336e4b7e0eee419, user_id=4b5c40417fe143e3b4a100405e55b647, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:13.444549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:13.462503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 68/126] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:13 2022] PUT /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/4b5c40417fe143e3b4a100405e55b647/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:13.463555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:13.562009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443f7c7-d82c-4b6c-9a75-0b03a7b579aa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:13.600532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea94281-31e4-4250-8c03-c1db90cb4069 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:13.650715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:13.652034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:13.653302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:13.653724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:13.660046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:13.660046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:13.660046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:13.660046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:13.660501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:13.660501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:13.660501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:13.671183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 69/127] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:13.672704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:13.680959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:13.695427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:13.696452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:13.697237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 59/128] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:13.697869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:13.701875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:13.735581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:13.854914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca2d5f-2346-48cb-86b9-d61df9ae2b35 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:13.877639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a4bb4-9310-4f5d-ac76-048492039d66 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:13.907690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:13.908745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:13.909035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:13.909335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:13.911401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:13.915088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:13.918976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 70/129] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:13 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:13.920493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:13.923738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:13.924800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:13.925362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:13.925820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:13.927472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:13.929290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:13.931246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 60/130] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:13 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:13.932334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:14.092988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:14.102211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:14.118714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c97b1-cfe7-474a-845f-94cbd6b6ff0e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:14.157704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925d17-4b5f-4f8c-99f8-9f749741933a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:14.197332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:14.198402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:14.200453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:14.200949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:14.201821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:14.202525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:14.207010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:14.223715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 71/131] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:14.225551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:14.237504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:14.240285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:14.240961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:14.241416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:14.242350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] RBAC: Adding query filter params (role.id=c6a091ec4393414da501df193e374be8, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=1a7aad960ec845758deae21a0efc1eb0) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:14.242839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:14.245106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:14.254650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 61/132] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:13 2022] GET /identity/v3/role_assignments?user.id=1a7aad960ec845758deae21a0efc1eb0&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=c6a091ec4393414da501df193e374be8 => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:14.257299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:14.416512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0bb97f-b2a0-4d12-b7d5-6cd8775cf73c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:14.425094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8fc9d-0139-479e-8cc9-ca8d015f69de None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:14.473668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:14.474633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:14.475202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:14.475670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:14.477238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:14.479001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:14.482331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 62/133] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:14 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:14.487933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:14.502520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:14.506212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:14.506895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:14.507179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:14.507487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] PATH_INFO: `/v3/projects/0abaff425fbb406aaa9d01b85e815ad1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:14.508756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] RBAC: Authorizing `identity:get_project(project_id=0abaff425fbb406aaa9d01b85e815ad1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:14.510431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:14.512933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 72/134] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:14 2022] GET /identity/v3/projects/0abaff425fbb406aaa9d01b85e815ad1 => generated 312 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:14.518707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:14.557384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:14.671451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1669b6-7daf-4279-a4bf-2f04086d279d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:14.708790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879151d-ea81-4210-aa56-1c5012717d80 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:14.713099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:14.713238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:14.713637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:14.713925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:14.715768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:14.717336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:14.719242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 63/135] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:14 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:14.725728 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:14.750583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87069c07-5c23-4be2-ba09-52c176d10726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:14.751703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069c07-5c23-4be2-ba09-52c176d10726 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:14.752225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069c07-5c23-4be2-ba09-52c176d10726 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:14.752698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87069c07-5c23-4be2-ba09-52c176d10726 None admin] PATH_INFO: `/v3/projects/0abaff425fbb406aaa9d01b85e815ad1/users/90a2d633b13745feaca9fcbc613a1b38/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:14.754992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069c07-5c23-4be2-ba09-52c176d10726 None admin] RBAC: Authorizing `identity:create_grant(project_id=0abaff425fbb406aaa9d01b85e815ad1, user_id=90a2d633b13745feaca9fcbc613a1b38, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:14.756740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87069c07-5c23-4be2-ba09-52c176d10726 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:14.775671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 73/136] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:14 2022] PUT /identity/v3/projects/0abaff425fbb406aaa9d01b85e815ad1/users/90a2d633b13745feaca9fcbc613a1b38/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:46:14.827861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:14.864114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a799131-41d5-4b2e-a63d-fae72757d62d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:14.914556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da423749-dcf9-4513-adf2-4bb21fd6e284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:14.915253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423749-dcf9-4513-adf2-4bb21fd6e284 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:14.915543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423749-dcf9-4513-adf2-4bb21fd6e284 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:14.915821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da423749-dcf9-4513-adf2-4bb21fd6e284 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/90a2d633b13745feaca9fcbc613a1b38/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:14.921755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423749-dcf9-4513-adf2-4bb21fd6e284 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f9f5af9f6441b2a336e4b7e0eee419, user_id=90a2d633b13745feaca9fcbc613a1b38, role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:14.923239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da423749-dcf9-4513-adf2-4bb21fd6e284 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:14.942282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 64/137] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:14 2022] PUT /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/90a2d633b13745feaca9fcbc613a1b38/roles/e02cd49dfc6343ce87700207db79ff78 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:15.065409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f467edb-307c-4e97-aa2c-baa8346963ad None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:15.066046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f467edb-307c-4e97-aa2c-baa8346963ad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:15.066523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f467edb-307c-4e97-aa2c-baa8346963ad None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:15.068220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 74/138] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:15.074995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfad60-2654-492e-9e8d-56173118cea6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:15.075435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfad60-2654-492e-9e8d-56173118cea6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:15.075604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfad60-2654-492e-9e8d-56173118cea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:15.101320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a9dfad60-2654-492e-9e8d-56173118cea6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:15.102772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a9dfad60-2654-492e-9e8d-56173118cea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:15.200118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 65/139] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:15.537629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f467edb-307c-4e97-aa2c-baa8346963ad None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:15.631005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:15.658011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73cdb5-d9f0-450c-8a2a-1ce93babe467 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:15.658355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73cdb5-d9f0-450c-8a2a-1ce93babe467 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:15.658580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73cdb5-d9f0-450c-8a2a-1ce93babe467 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:15.659929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 66/140] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:46:15.665880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdcfbd-3dd2-472d-bfa5-695cbfc8a75f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:15.666162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdcfbd-3dd2-472d-bfa5-695cbfc8a75f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:15.666439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdcfbd-3dd2-472d-bfa5-695cbfc8a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:15.678176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f467edb-307c-4e97-aa2c-baa8346963ad None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:15.694475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f2cdcfbd-3dd2-472d-bfa5-695cbfc8a75f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:15.695687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f2cdcfbd-3dd2-472d-bfa5-695cbfc8a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:15.747708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:15.748371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:15.748624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:15.748898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:15.752694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:15.754149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:15.756054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 75/141] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:15.762072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:15.782289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:15.800328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 67/142] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:15.917166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f6364-0c84-4d60-872f-839574ef1333 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:15.971042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:15.971661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:15.971942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:15.972239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:15.972899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:15.974346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:16.005470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 76/143] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:46:15 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:16.155097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdcfbd-3dd2-472d-bfa5-695cbfc8a75f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:16.285924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdcfbd-3dd2-472d-bfa5-695cbfc8a75f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:16.328344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:16.329497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:16.329991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:16.330472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:16.347208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:16.352775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:16.353765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:16.354578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:16.357949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 68/144] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:16.365182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:16.368456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:16.521980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe12ea-5965-4706-8752-c386fefa1f53 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:16.566186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:16.566814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:16.567093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:16.567368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:16.568054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:16.568368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:16.569764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:16.581493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 77/145] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:16.587502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:16.681518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:16.741725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917326e-89ea-4d59-aa6d-08f9f767d5ec None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:16.788832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bea5c-3609-4a6d-8dd9-86554e204e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:16.789398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bea5c-3609-4a6d-8dd9-86554e204e23 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:16.789680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bea5c-3609-4a6d-8dd9-86554e204e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:16.789953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bea5c-3609-4a6d-8dd9-86554e204e23 None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:16.791741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bea5c-3609-4a6d-8dd9-86554e204e23 None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:16.793825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bea5c-3609-4a6d-8dd9-86554e204e23 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:16.795747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 69/146] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:16 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:16.803822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:16.896039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:16.955254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6257bf-451b-4879-bf68-e4aba1fd7518 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:17.002406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:17.003026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:17.003310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:17.003581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:17.056752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc97bc-24ac-417e-aba7-62423b6efb8d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:17.056752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc97bc-24ac-417e-aba7-62423b6efb8d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:17.057170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc97bc-24ac-417e-aba7-62423b6efb8d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:17.059168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 70/147] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:17.077864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3833-7d97-4955-9564-4c6560035ec1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:17.078173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3833-7d97-4955-9564-4c6560035ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:17.078427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac3833-7d97-4955-9564-4c6560035ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:17.101119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:17.102602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:17.104338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-81ac3833-7d97-4955-9564-4c6560035ec1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:17.106623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-81ac3833-7d97-4955-9564-4c6560035ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:17.200997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 71/148] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:17.213376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:17.265861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 78/149] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 12:46:17.271539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3833-7d97-4955-9564-4c6560035ec1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:17.342386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:17.409317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac3833-7d97-4955-9564-4c6560035ec1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:17.459973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d5f04-a7e5-43ce-bc30-bb1bdfd1b66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:17.460726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5f04-a7e5-43ce-bc30-bb1bdfd1b66a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:17.461009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5f04-a7e5-43ce-bc30-bb1bdfd1b66a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:17.461289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d5f04-a7e5-43ce-bc30-bb1bdfd1b66a None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:17.462439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d5f04-a7e5-43ce-bc30-bb1bdfd1b66a None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:17.463889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d5f04-a7e5-43ce-bc30-bb1bdfd1b66a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:17.466846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 72/150] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:17 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:17.472390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:17.591122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086287c4-8171-4eca-ad95-f0fcf91381e8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:17.632832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50c0eb-a782-42c0-b809-8dfac287ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:17.636044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50c0eb-a782-42c0-b809-8dfac287ee18 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:17.636044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50c0eb-a782-42c0-b809-8dfac287ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:17.636044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50c0eb-a782-42c0-b809-8dfac287ee18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:17.636044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50c0eb-a782-42c0-b809-8dfac287ee18 None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=90a2d633b13745feaca9fcbc613a1b38) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:17.636044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50c0eb-a782-42c0-b809-8dfac287ee18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:17.637093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50c0eb-a782-42c0-b809-8dfac287ee18 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:17.650048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 79/151] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:17 2022] GET /identity/v3/role_assignments?user.id=90a2d633b13745feaca9fcbc613a1b38&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:17.685319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccb4e-1fd0-497e-bb5e-db27ecbaa6f0 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:17.685660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccb4e-1fd0-497e-bb5e-db27ecbaa6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:17.685897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ccb4e-1fd0-497e-bb5e-db27ecbaa6f0 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:17.687640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 73/152] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:17.698860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782d90-818e-4873-954c-2c108f0012a4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:17.699174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782d90-818e-4873-954c-2c108f0012a4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:17.699587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71782d90-818e-4873-954c-2c108f0012a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:17.723256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-71782d90-818e-4873-954c-2c108f0012a4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:17.724489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-71782d90-818e-4873-954c-2c108f0012a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:17.757305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:17.814162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 80/153] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:17.833234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ccb4e-1fd0-497e-bb5e-db27ecbaa6f0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:17.966829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ccb4e-1fd0-497e-bb5e-db27ecbaa6f0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:18.001805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:18.014660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:18.015304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:18.015652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:18.015931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:18.030361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:18.035267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:18.036210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:18.036978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 74/154] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:18.042458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71782d90-818e-4873-954c-2c108f0012a4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:18.178851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71782d90-818e-4873-954c-2c108f0012a4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:18.218838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:18.219384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:18.219658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:18.219926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:18.220743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:18.221047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:18.222555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:18.234914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 81/155] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:18.240692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:18.392822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e74b6b-d259-4dde-bd60-e6c764e7fefa None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:18.446085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:18.446730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:18.447011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:18.447287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] PATH_INFO: `/v3/users/4b5c40417fe143e3b4a100405e55b647` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:18.448440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] RBAC: Authorizing `identity:get_user(user_id=4b5c40417fe143e3b4a100405e55b647)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:18.450313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:18.452242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 75/156] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:18 2022] GET /identity/v3/users/4b5c40417fe143e3b4a100405e55b647 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:18.456478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:18.457830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:18.498350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:18.588398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:18.645679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97549-b9d0-4169-9a6f-19d1d24381ea None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:18.740950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ae98d-f406-439c-986e-ad87ce4671d6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:18.744206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:18.744862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:18.745137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:18.745408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:18.769031 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:18.780765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:18.782018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:18.782993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:18.786257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 82/157] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:18.795718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:18.833857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d3f50-93b0-4ce9-b56d-4f81142014da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:18.836801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d3f50-93b0-4ce9-b56d-4f81142014da None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:18.837275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d3f50-93b0-4ce9-b56d-4f81142014da None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:18.838904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d3f50-93b0-4ce9-b56d-4f81142014da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.016397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:19.045956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d3f50-93b0-4ce9-b56d-4f81142014da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:19.047363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d3f50-93b0-4ce9-b56d-4f81142014da None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:19.074392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819750da-6209-4b86-b1a6-81ee2756d4e1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:19.178317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7316d-382f-481e-90d0-2b0b76bd7e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:19.179687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7316d-382f-481e-90d0-2b0b76bd7e59 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.180261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7316d-382f-481e-90d0-2b0b76bd7e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.180811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7316d-382f-481e-90d0-2b0b76bd7e59 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.182267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7316d-382f-481e-90d0-2b0b76bd7e59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:19.182600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7316d-382f-481e-90d0-2b0b76bd7e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:19.184896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7316d-382f-481e-90d0-2b0b76bd7e59 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:19.200468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:19.209095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 83/158] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:19.210461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d341-ae3e-43ac-9e46-bfa820c6b857 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.210739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d341-ae3e-43ac-9e46-bfa820c6b857 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.211009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7d341-ae3e-43ac-9e46-bfa820c6b857 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.212850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 84/159] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:19.217200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d341-ae3e-43ac-9e46-bfa820c6b857 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:19.314365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 76/160] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 12:46:19.316501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00180812-ce7a-4786-a76b-03c8547ab5d9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.317000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00180812-ce7a-4786-a76b-03c8547ab5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.317454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00180812-ce7a-4786-a76b-03c8547ab5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.380205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-00180812-ce7a-4786-a76b-03c8547ab5d9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:19.381436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-00180812-ce7a-4786-a76b-03c8547ab5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:19.443897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7d341-ae3e-43ac-9e46-bfa820c6b857 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:19.509363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c6b16-d602-4490-ba17-103e73b899f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:19.510407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c6b16-d602-4490-ba17-103e73b899f3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.510878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c6b16-d602-4490-ba17-103e73b899f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.511395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c6b16-d602-4490-ba17-103e73b899f3 None admin] PATH_INFO: `/v3/users/1a7aad960ec845758deae21a0efc1eb0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.513489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c6b16-d602-4490-ba17-103e73b899f3 None admin] RBAC: Authorizing `identity:get_user(user_id=1a7aad960ec845758deae21a0efc1eb0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:19.516283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c6b16-d602-4490-ba17-103e73b899f3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:19.519607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 85/161] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:19 2022] GET /identity/v3/users/1a7aad960ec845758deae21a0efc1eb0 => generated 289 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:19.521740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1cc3-13a5-4c76-bc27-e2d32f7ca041 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.522210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1cc3-13a5-4c76-bc27-e2d32f7ca041 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.522694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c1cc3-13a5-4c76-bc27-e2d32f7ca041 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.525533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 86/162] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:19.527117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1cc3-13a5-4c76-bc27-e2d32f7ca041 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:19.551226 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:19.569756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 77/163] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:19.570467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00180812-ce7a-4786-a76b-03c8547ab5d9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:19.721801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c1cc3-13a5-4c76-bc27-e2d32f7ca041 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:19.772378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:19.784763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045dd50-448a-4c6f-9406-2698af50e6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:19.785807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045dd50-448a-4c6f-9406-2698af50e6ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.786278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045dd50-448a-4c6f-9406-2698af50e6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.786815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045dd50-448a-4c6f-9406-2698af50e6ec None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.788740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045dd50-448a-4c6f-9406-2698af50e6ec None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:19.791346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045dd50-448a-4c6f-9406-2698af50e6ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:19.794577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 87/164] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:19 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:19.796652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5513-2091-4088-a0bd-e4e11c2aa142 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.797203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5513-2091-4088-a0bd-e4e11c2aa142 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.797672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea5513-2091-4088-a0bd-e4e11c2aa142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.810313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00180812-ce7a-4786-a76b-03c8547ab5d9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:19.834667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-78ea5513-2091-4088-a0bd-e4e11c2aa142 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:19.835796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-78ea5513-2091-4088-a0bd-e4e11c2aa142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:19.882599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:19.883954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:19.884484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:19.884956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:19.888759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:19.890530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:19.892502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 78/165] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:19 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:19.893623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:19.932402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 88/166] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:19.933855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea5513-2091-4088-a0bd-e4e11c2aa142 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:19.944584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:20.055775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea5513-2091-4088-a0bd-e4e11c2aa142 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:20.099171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:20.100186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:20.100646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:20.101078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/1a7aad960ec845758deae21a0efc1eb0/roles/c6a091ec4393414da501df193e374be8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:20.103234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f9f5af9f6441b2a336e4b7e0eee419, user_id=1a7aad960ec845758deae21a0efc1eb0, role_id=c6a091ec4393414da501df193e374be8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:20.104880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:20.122941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 89/167] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:19 2022] PUT /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/users/1a7aad960ec845758deae21a0efc1eb0/roles/c6a091ec4393414da501df193e374be8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:20.127999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278f026-7585-49e9-b2b8-14b98c57e01f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:20.193567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:20.194208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:20.194485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:20.194771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:20.195542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=4b5c40417fe143e3b4a100405e55b647) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:20.195852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:20.197366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:20.208914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 79/168] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:19 2022] GET /identity/v3/role_assignments?user.id=4b5c40417fe143e3b4a100405e55b647&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:20.245163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:20.334146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:20.378613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb175f-57f7-429b-a65e-08105bfdd4b5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:20.444377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:20.445989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:20.446781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:20.447621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:20.471009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:20.479398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:20.481227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:20.482214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:20.485323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 90/169] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:20.491792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:20.522694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:20.656655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4e80c2-f328-42cb-8840-1133d8c6a8d8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:20.695432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:20.696075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:20.696362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:20.696619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:20.697296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:20.697600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:20.699515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:20.711870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 80/170] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:20.719036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:20.857317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:20.907075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78d815-8065-4a5f-afde-f825ee21c769 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:20.965111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:20.978482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:20.979134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:20.979413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:20.979686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:20.981297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:20.982762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:20.988507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 91/171] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:20 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:20.995716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:21.032403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:21.093370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01ebb2-1231-4258-8384-6a0cabeaf630 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:21.175823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c6b39-7968-4bd1-9f1e-5fb34250c39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:21.176425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6b39-7968-4bd1-9f1e-5fb34250c39c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.176705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6b39-7968-4bd1-9f1e-5fb34250c39c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.176974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6b39-7968-4bd1-9f1e-5fb34250c39c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.178413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f01f90-0a04-4b34-9d1d-14b4a2db361c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:21.192206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c6b39-7968-4bd1-9f1e-5fb34250c39c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b72c6b39-7968-4bd1-9f1e-5fb34250c39c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:21.197982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:21.199143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:21.200570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 81/172] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:21.201359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786cedd-e677-4c14-b94a-9dd31d3d836f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.201359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786cedd-e677-4c14-b94a-9dd31d3d836f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.201677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786cedd-e677-4c14-b94a-9dd31d3d836f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.202825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 82/173] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:21.209242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786cedd-e677-4c14-b94a-9dd31d3d836f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:21.229370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779e4f2-5478-4c4a-a0e5-6b70372922b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:21.231113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779e4f2-5478-4c4a-a0e5-6b70372922b0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.231408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779e4f2-5478-4c4a-a0e5-6b70372922b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.231688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779e4f2-5478-4c4a-a0e5-6b70372922b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.338444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:21.347081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779e4f2-5478-4c4a-a0e5-6b70372922b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:21.348619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779e4f2-5478-4c4a-a0e5-6b70372922b0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:21.361351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786cedd-e677-4c14-b94a-9dd31d3d836f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:21.398446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48855fa-5cb2-4c7a-b944-237fc25acda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:21.399153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48855fa-5cb2-4c7a-b944-237fc25acda7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.399425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48855fa-5cb2-4c7a-b944-237fc25acda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.399726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48855fa-5cb2-4c7a-b944-237fc25acda7 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.400505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48855fa-5cb2-4c7a-b944-237fc25acda7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:21.400810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48855fa-5cb2-4c7a-b944-237fc25acda7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:21.403184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48855fa-5cb2-4c7a-b944-237fc25acda7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:21.404978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:21.415576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 83/174] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:21.417104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1fb94-4662-437f-9ff7-491d00f015c5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.418184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1fb94-4662-437f-9ff7-491d00f015c5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.418744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1fb94-4662-437f-9ff7-491d00f015c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.437920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f9e1fb94-4662-437f-9ff7-491d00f015c5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:21.439333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f9e1fb94-4662-437f-9ff7-491d00f015c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:21.467600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 92/175] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 12:46:21.469567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c769-32b8-47f6-9f51-86079ab4a6fd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.469950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c769-32b8-47f6-9f51-86079ab4a6fd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.470305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c769-32b8-47f6-9f51-86079ab4a6fd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.473480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 93/176] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:21.476153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c769-32b8-47f6-9f51-86079ab4a6fd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:21.531525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 84/177] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:21.540530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1fb94-4662-437f-9ff7-491d00f015c5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:21.593061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:21.609891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c769-32b8-47f6-9f51-86079ab4a6fd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:21.691323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d36fd6-f94d-4bf9-b6b6-3e8e02962626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:21.691889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d36fd6-f94d-4bf9-b6b6-3e8e02962626 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.692197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d36fd6-f94d-4bf9-b6b6-3e8e02962626 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.692471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d36fd6-f94d-4bf9-b6b6-3e8e02962626 None admin] PATH_INFO: `/v3/users/90a2d633b13745feaca9fcbc613a1b38` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.695947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d36fd6-f94d-4bf9-b6b6-3e8e02962626 None admin] RBAC: Authorizing `identity:get_user(user_id=90a2d633b13745feaca9fcbc613a1b38)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:21.697460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d36fd6-f94d-4bf9-b6b6-3e8e02962626 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:21.705874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1fb94-4662-437f-9ff7-491d00f015c5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:21.707620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 94/178] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:21 2022] GET /identity/v3/users/90a2d633b13745feaca9fcbc613a1b38 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:21.709029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448396-fde5-4b5c-bcf9-9eb64facdcd1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.709312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448396-fde5-4b5c-bcf9-9eb64facdcd1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.709583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9448396-fde5-4b5c-bcf9-9eb64facdcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.735311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d9448396-fde5-4b5c-bcf9-9eb64facdcd1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:21.736596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d9448396-fde5-4b5c-bcf9-9eb64facdcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:21.762851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:21.785384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:21.786037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:21.786315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:21.786585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:21.789885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:21.791430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:21.794841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 85/179] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:21 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:21.796748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:21.876859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 95/180] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:21.877939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448396-fde5-4b5c-bcf9-9eb64facdcd1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:21.983016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe457cc-2a4f-4b66-ba32-c4ba15f49435 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.017993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:22.026235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9448396-fde5-4b5c-bcf9-9eb64facdcd1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.041562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1140229-b7b3-4f52-bac6-f38a97f8954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.043668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1140229-b7b3-4f52-bac6-f38a97f8954d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.044137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1140229-b7b3-4f52-bac6-f38a97f8954d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.044555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1140229-b7b3-4f52-bac6-f38a97f8954d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.074673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60d1aa-f097-40d2-bc28-a23acdc1c3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.075475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d1aa-f097-40d2-bc28-a23acdc1c3ee None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.075852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d1aa-f097-40d2-bc28-a23acdc1c3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.076268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60d1aa-f097-40d2-bc28-a23acdc1c3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.077728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60d1aa-f097-40d2-bc28-a23acdc1c3ee None admin] RBAC: Adding query filter params (role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=90a2d633b13745feaca9fcbc613a1b38) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:22.078186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60d1aa-f097-40d2-bc28-a23acdc1c3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:22.080109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60d1aa-f097-40d2-bc28-a23acdc1c3ee None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:22.087789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 96/181] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:21 2022] GET /identity/v3/role_assignments?user.id=90a2d633b13745feaca9fcbc613a1b38&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:22.089211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfc3dd-027c-46d6-a236-b75e6f32dd5e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.090211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfc3dd-027c-46d6-a236-b75e6f32dd5e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.090587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfc3dd-027c-46d6-a236-b75e6f32dd5e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.092048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 97/182] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:22.096301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfc3dd-027c-46d6-a236-b75e6f32dd5e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.131995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:22.143003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1140229-b7b3-4f52-bac6-f38a97f8954d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:22.144799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1140229-b7b3-4f52-bac6-f38a97f8954d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:22.223220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfc3dd-027c-46d6-a236-b75e6f32dd5e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.289820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 86/183] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:22.291913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead150d6-0364-4af2-84c3-dce31fe48e56 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.293092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead150d6-0364-4af2-84c3-dce31fe48e56 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.293745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead150d6-0364-4af2-84c3-dce31fe48e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.298013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.299059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.299676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.300191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.318229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ead150d6-0364-4af2-84c3-dce31fe48e56 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:22.319806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ead150d6-0364-4af2-84c3-dce31fe48e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:22.321569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:22.331757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:22.332744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:22.333534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:22.334159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 98/184] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:22.335723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.367522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:22.408826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 87/185] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:22.409923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead150d6-0364-4af2-84c3-dce31fe48e56 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.452334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:22.468953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cc919-6047-4c3f-9265-f3343138e9c6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.515232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.516568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.517663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.518140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.534768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:22.542981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:22.544444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:22.545245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:22.548937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 99/186] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:22.550421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.560591 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead150d6-0364-4af2-84c3-dce31fe48e56 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.609595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.610306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.610589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.610866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] PATH_INFO: `/v3/projects/0abaff425fbb406aaa9d01b85e815ad1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.612034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] RBAC: Authorizing `identity:get_project(project_id=0abaff425fbb406aaa9d01b85e815ad1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:22.613529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:22.615606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 88/187] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/projects/0abaff425fbb406aaa9d01b85e815ad1 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:22.615944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.668891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:22.700714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4691a6-ad64-407a-87eb-eaec8aeaa76b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.730797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:22.740383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eceffcb-7eb4-44b3-8c94-9b56a1afad43 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.744087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.744714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.744997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.745270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.746112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:22.746649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:22.748152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:22.758542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 100/188] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:22.759398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.785136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.786097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.786349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.787237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.787486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:22.788199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:22.790091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:22.801719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 89/189] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:22.802492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.882088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce04855-530b-4b94-9a83-ce1eeca99503 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.921024 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.921911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.922194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.922467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.923199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=0abaff425fbb406aaa9d01b85e815ad1, user.id=90a2d633b13745feaca9fcbc613a1b38) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:22.923467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38d2f5-df18-4b72-b887-0a641f6de111 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:22.923567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:22.925073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:22.940179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 101/190] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/role_assignments?user.id=90a2d633b13745feaca9fcbc613a1b38&scope.project.id=0abaff425fbb406aaa9d01b85e815ad1&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:22.940179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:22.944899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:22.981628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:22.982590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:22.982872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:22.983743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:22.985607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:22.988329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:22.990499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 90/191] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:22.992243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:23.024381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:23.096143 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08082d7f-e52d-49b8-82a5-5656847548e3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:23.117761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a03e47-fd3e-4151-90c2-4e33fd64991b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:23.146735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:23.147408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.147706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.147966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] PATH_INFO: `/v3/users/b41e1301ed5247d98c9385c3ae4bfefb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.162654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:23.163757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.164664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.165243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] PATH_INFO: `/v3/users/b41e1301ed5247d98c9385c3ae4bfefb` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.167919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] RBAC: Authorizing `identity:get_user(user_id=b41e1301ed5247d98c9385c3ae4bfefb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:23.171487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:23.173898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 102/192] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/users/b41e1301ed5247d98c9385c3ae4bfefb => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:23.173898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:23.188368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] RBAC: Authorizing `identity:get_user(user_id=b41e1301ed5247d98c9385c3ae4bfefb)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:23.190207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:23.192790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 91/193] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:22 2022] GET /identity/v3/users/b41e1301ed5247d98c9385c3ae4bfefb => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:23.194315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:23.270811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:23.307215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:23.319706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca6b961-6ff3-4c2d-bfe1-3d21b8e1c9bb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:23.330587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a515b-d291-4945-a95c-90900490a9a2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:23.357419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:23.357951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.358228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.358499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.359151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:23.360641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:23.367820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c3ecc-2c79-4bb0-9978-7a5018d0648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:23.368462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3ecc-2c79-4bb0-9978-7a5018d0648e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.368752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3ecc-2c79-4bb0-9978-7a5018d0648e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.369023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c3ecc-2c79-4bb0-9978-7a5018d0648e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.393474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 103/194] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:46:23 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:23.393474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:23.451575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3ecc-2c79-4bb0-9978-7a5018d0648e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:23.453127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c3ecc-2c79-4bb0-9978-7a5018d0648e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:23.522201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ad4c3-9ecc-4909-86fb-916fb3e2c226 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:23.545107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:23.553084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:23.571262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:23.572066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.572350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.572639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.580878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 92/195] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:23.583300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c490d-ee34-4e31-bc1a-8435480df87d None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.583761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c490d-ee34-4e31-bc1a-8435480df87d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.584273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c490d-ee34-4e31-bc1a-8435480df87d None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.586136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 93/196] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:23.587300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c490d-ee34-4e31-bc1a-8435480df87d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:23.659704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:23.661902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:23.735891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c490d-ee34-4e31-bc1a-8435480df87d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:23.776686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb83ca6-47b3-49b8-9545-a5e84aa9f4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:23.777998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83ca6-47b3-49b8-9545-a5e84aa9f4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.778374 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83ca6-47b3-49b8-9545-a5e84aa9f4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.778562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb83ca6-47b3-49b8-9545-a5e84aa9f4d9 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.779732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb83ca6-47b3-49b8-9545-a5e84aa9f4d9 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:23.781244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb83ca6-47b3-49b8-9545-a5e84aa9f4d9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:23.787789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 94/197] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:23 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:23.787789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8af1ec-ce7b-4cd5-b03b-04235dda645b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:23.787789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8af1ec-ce7b-4cd5-b03b-04235dda645b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:23.787789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8af1ec-ce7b-4cd5-b03b-04235dda645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:23.806681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-de8af1ec-ce7b-4cd5-b03b-04235dda645b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:23.807936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-de8af1ec-ce7b-4cd5-b03b-04235dda645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:23.809898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 104/198] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:23.810690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:23.838800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:23.895516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:23.927075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 95/199] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:23.928420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8af1ec-ce7b-4cd5-b03b-04235dda645b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:23.967808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4051b362-56f9-4f9e-84f2-e47c007fd7d1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:24.018430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:24.019413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:24.019872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:24.020550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:24.022358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=b41e1301ed5247d98c9385c3ae4bfefb) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:24.023372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:24.025430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:24.035813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 105/200] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:23 2022] GET /identity/v3/role_assignments?user.id=b41e1301ed5247d98c9385c3ae4bfefb&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:24.075037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8af1ec-ce7b-4cd5-b03b-04235dda645b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:24.128234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:24.129144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:24.129432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:24.129704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:24.130945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:24.132552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:24.134662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 96/201] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:23 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:24.141246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:24.266542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:24.270873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:24.301242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ef7e9-d474-4b34-a144-20b3fa1d6c08 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:24.352408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:24.383310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:24.384038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:24.384321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:24.384599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:24.385346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] RBAC: Adding query filter params (role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=b41e1301ed5247d98c9385c3ae4bfefb) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:24.385654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:24.387523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:24.401951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 106/202] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:24 2022] GET /identity/v3/role_assignments?user.id=b41e1301ed5247d98c9385c3ae4bfefb&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:24.431349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332dbe2-1f88-4dcb-bd6e-8d48edfe2f2f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:24.472168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:24.472850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:24.473123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:24.473388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:24.486223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:24.491316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:24.492269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:24.493158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 97/203] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:24.499015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:24.615156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83b82d-9fd5-4a73-baa1-1e222223586b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:24.656587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:24.657524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:24.657896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:24.658238 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:24.658951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:24.659333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:24.660781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:24.671194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 107/204] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:24.677347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:24.805461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b570c5-c250-4654-802c-bd77afeedf35 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:24.814232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:24.844216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:24.844911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:24.845192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:24.845463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] PATH_INFO: `/v3/users/1a7aad960ec845758deae21a0efc1eb0` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:24.846650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] RBAC: Authorizing `identity:get_user(user_id=1a7aad960ec845758deae21a0efc1eb0)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:24.848155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:24.850150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 98/205] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:24 2022] GET /identity/v3/users/1a7aad960ec845758deae21a0efc1eb0 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:24.856579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:24.868988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:24.962773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b733dd6-f130-4183-9ecc-080a2aaf5554 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:24.999372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:24.999996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:25.000303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:25.000710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:25.088050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:25.089602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:25.112645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:25.204198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 108/206] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:25.207135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:25.320322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5cb5-cee8-4e3d-a293-bb10578e50fe None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:25.360524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbefb9-8013-46b6-a5a4-cd28f689d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:25.361178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbefb9-8013-46b6-a5a4-cd28f689d843 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:25.361455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbefb9-8013-46b6-a5a4-cd28f689d843 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:25.361727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbefb9-8013-46b6-a5a4-cd28f689d843 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:25.362870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbefb9-8013-46b6-a5a4-cd28f689d843 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:25.364335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbefb9-8013-46b6-a5a4-cd28f689d843 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:25.366345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 99/207] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:25 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:25.372750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:25.483046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6097b-8a4a-4eb1-a7aa-e9cd997809b6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:25.492937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:25.535867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126ce89-240b-45a1-ace4-1793db6fc0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:25.536523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ce89-240b-45a1-ace4-1793db6fc0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:25.536803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ce89-240b-45a1-ace4-1793db6fc0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:25.537080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126ce89-240b-45a1-ace4-1793db6fc0a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:25.537873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126ce89-240b-45a1-ace4-1793db6fc0a0 None admin] RBAC: Adding query filter params (role.id=c6a091ec4393414da501df193e374be8, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419, user.id=1a7aad960ec845758deae21a0efc1eb0) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:25.538185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126ce89-240b-45a1-ace4-1793db6fc0a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:25.539635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126ce89-240b-45a1-ace4-1793db6fc0a0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:25.550596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 109/208] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:25 2022] GET /identity/v3/role_assignments?user.id=1a7aad960ec845758deae21a0efc1eb0&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=c6a091ec4393414da501df193e374be8 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:26.094916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132655-7ab2-4061-bade-b6a5b60a81af None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:26.095603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132655-7ab2-4061-bade-b6a5b60a81af None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:26.096172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94132655-7ab2-4061-bade-b6a5b60a81af None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:26.097963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 100/209] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:26.103927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b002b-03ec-4f7f-9992-bc6360247fc4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:26.104237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b002b-03ec-4f7f-9992-bc6360247fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:26.104519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b002b-03ec-4f7f-9992-bc6360247fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:26.127236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-941b002b-03ec-4f7f-9992-bc6360247fc4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:26.128859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-941b002b-03ec-4f7f-9992-bc6360247fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:26.208383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 110/210] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:26.410132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bfd83-b799-4ccd-9d54-cf191a8b8e7b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:26.411130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bfd83-b799-4ccd-9d54-cf191a8b8e7b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:26.411664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bfd83-b799-4ccd-9d54-cf191a8b8e7b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:26.413642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 101/211] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:26.419356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5735c-e221-481b-bfff-914aba0774fc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:26.420062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5735c-e221-481b-bfff-914aba0774fc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:26.420062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5735c-e221-481b-bfff-914aba0774fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:26.438642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9bf5735c-e221-481b-bfff-914aba0774fc None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:26.439854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9bf5735c-e221-481b-bfff-914aba0774fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:26.502105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bfd83-b799-4ccd-9d54-cf191a8b8e7b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:26.516522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 111/212] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:26.553105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:26.619776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bfd83-b799-4ccd-9d54-cf191a8b8e7b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:26.667413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:26.668709 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:26.669188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:26.669650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:26.681907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:26.687540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:26.688455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:26.689260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 102/213] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:26.697697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5735c-e221-481b-bfff-914aba0774fc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:26.732441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:26.817898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5735c-e221-481b-bfff-914aba0774fc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:26.830361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:26.857667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:26.858109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:26.858392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:26.858664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:26.859342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:26.859652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:26.861073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:26.875778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 112/214] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:26.878040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:26.953959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb6cb2-0a12-4c87-9ed3-7bbe20567864 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:26.955807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:26.990016 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:26.994999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d011117-e20a-4892-9715-6193bc326270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:26.996249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d011117-e20a-4892-9715-6193bc326270 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:26.996684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d011117-e20a-4892-9715-6193bc326270 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:26.996960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d011117-e20a-4892-9715-6193bc326270 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:26.998031 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c750b-6fca-4022-8c52-d71110e7ff77 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:26.998134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d011117-e20a-4892-9715-6193bc326270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:26.999951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d011117-e20a-4892-9715-6193bc326270 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:27.008991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 103/215] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:27.008991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46392fc-d3e0-4ed3-bbf9-82ffdd8e0d18 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.008991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46392fc-d3e0-4ed3-bbf9-82ffdd8e0d18 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.008991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46392fc-d3e0-4ed3-bbf9-82ffdd8e0d18 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.008991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 104/216] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:27.010535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46392fc-d3e0-4ed3-bbf9-82ffdd8e0d18 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:27.048274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194083-238b-464b-8d86-20e3317e7e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:27.049212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194083-238b-464b-8d86-20e3317e7e21 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.049651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194083-238b-464b-8d86-20e3317e7e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.050126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194083-238b-464b-8d86-20e3317e7e21 None admin] PATH_INFO: `/v3/users/0eee82133bcf403eb3e911af1b53ae92` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.065372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194083-238b-464b-8d86-20e3317e7e21 None admin] RBAC: Authorizing `identity:get_user(user_id=0eee82133bcf403eb3e911af1b53ae92)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:27.067083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194083-238b-464b-8d86-20e3317e7e21 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:27.074310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 113/217] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:26 2022] GET /identity/v3/users/0eee82133bcf403eb3e911af1b53ae92 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:27.076064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4716-d769-41de-ad85-45775eb6868b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.076540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4716-d769-41de-ad85-45775eb6868b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.076861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d4716-d769-41de-ad85-45775eb6868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.097370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1b8d4716-d769-41de-ad85-45775eb6868b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:27.098802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1b8d4716-d769-41de-ad85-45775eb6868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:27.123493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46392fc-d3e0-4ed3-bbf9-82ffdd8e0d18 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:27.175724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab2f76-4347-4bab-8cb9-2a40d719c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:27.176764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2f76-4347-4bab-8cb9-2a40d719c5b7 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.177223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2f76-4347-4bab-8cb9-2a40d719c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.177673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab2f76-4347-4bab-8cb9-2a40d719c5b7 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.178803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2f76-4347-4bab-8cb9-2a40d719c5b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:27.181601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab2f76-4347-4bab-8cb9-2a40d719c5b7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:27.200041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 114/218] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:27.200041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4716-d769-41de-ad85-45775eb6868b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:27.232439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 105/219] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:46:27 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:46:27.354151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:27.376706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d4716-d769-41de-ad85-45775eb6868b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:27.417048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:27.418088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.418827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.419323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.421501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ebb2d-5a43-4223-8950-464bf5d46982 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.421981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ebb2d-5a43-4223-8950-464bf5d46982 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.422071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ebb2d-5a43-4223-8950-464bf5d46982 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.423472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 106/220] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:27.429171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b2752-d60f-460e-a5b1-8dfb8aad319f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.429451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b2752-d60f-460e-a5b1-8dfb8aad319f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.429722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b2752-d60f-460e-a5b1-8dfb8aad319f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.455259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ba8b2752-d60f-460e-a5b1-8dfb8aad319f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:27.456839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ba8b2752-d60f-460e-a5b1-8dfb8aad319f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:27.487182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:27.504561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:27.505780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:27.553843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 107/221] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:27.555028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b2752-d60f-460e-a5b1-8dfb8aad319f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:27.612530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:27.652068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 115/222] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:27.657080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:27.690324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b2752-d60f-460e-a5b1-8dfb8aad319f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:27.737414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:27.737975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.738262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.738530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.757142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:27.763320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:27.764301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:27.765113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:27.767546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 108/223] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:27.773939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:27.798436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:27.836103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc693f-7115-4473-be28-d154f5fedd8b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:27.876523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:27.877544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.877996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.878412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.879848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:27.881882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:27.884721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 116/224] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:27 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:27.896931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:27.940380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a46e49-cf64-4d23-9c07-7b2b58596e2b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:27.965738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:27.981972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:27.982607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:27.982884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:27.983158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:27.983845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:27.984200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:27.985739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:27.996294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 109/225] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:27.997149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:28.024398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bb794-1331-4e83-a88a-e1ce63d4040c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:28.064566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:28.065359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:28.065747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:28.066087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:28.066900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=0eee82133bcf403eb3e911af1b53ae92) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:28.067283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:28.068914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:28.084048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 117/226] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:27 2022] GET /identity/v3/role_assignments?user.id=0eee82133bcf403eb3e911af1b53ae92&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:28.084048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:28.128457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:28.184308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead49b3b-1bc6-4752-a008-950f9884b934 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:28.254409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:28.255420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:28.255939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:28.256437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:28.279702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:28.288589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:28.289557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:28.290370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:28.294493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 110/227] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:28.300320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:28.314203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09c66c-4f54-4131-9962-ebc10347258a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:28.336442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:28.357916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:28.359075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:28.359552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:28.360058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] PATH_INFO: `/v3/users/b41e1301ed5247d98c9385c3ae4bfefb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:28.361512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] RBAC: Authorizing `identity:get_user(user_id=b41e1301ed5247d98c9385c3ae4bfefb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:28.363284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:28.365164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 118/228] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:28 2022] GET /identity/v3/users/b41e1301ed5247d98c9385c3ae4bfefb => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:28.372166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:28.555032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d1f9a-8def-48ef-8561-b1433d8d59d1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:28.582701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89d29-a2ef-4139-92dc-b44350740505 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:28.639249 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:28.639907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:28.640220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:28.640498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:28.642461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:28.643918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:28.646394 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 119/229] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:28 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:28.652994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:28.657820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:28.658449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:28.658731 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:28.659003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:28.659674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:28.659978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:28.662814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:28.671496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:28.682406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 111/230] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:28.691206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:28.796750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:28.906245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5cb45-23b1-4806-a526-9a5f5047172e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:28.929555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2794f-1a61-4de9-b362-9b0c4c682f51 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:28.947215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:28.948290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:28.948991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:28.949466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/b41e1301ed5247d98c9385c3ae4bfefb/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:28.951784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] RBAC: Authorizing `identity:create_grant(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68, user_id=b41e1301ed5247d98c9385c3ae4bfefb, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:28.953600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:28.969437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 120/231] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:28 2022] PUT /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/b41e1301ed5247d98c9385c3ae4bfefb/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:29.017013 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:29.018807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:29.019361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:29.019865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] PATH_INFO: `/v3/users/b41e1301ed5247d98c9385c3ae4bfefb` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:29.022260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=b41e1301ed5247d98c9385c3ae4bfefb)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:29.025121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:29.034276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 112/232] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:28 2022] GET /identity/v3/users/b41e1301ed5247d98c9385c3ae4bfefb => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:29.035270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:29.171253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31bef9-8464-40af-a49b-125c7193b35d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:29.189548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:29.210853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edaf3e-8f05-4d6a-9314-f893dabf11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:29.211515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edaf3e-8f05-4d6a-9314-f893dabf11fa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:29.211793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edaf3e-8f05-4d6a-9314-f893dabf11fa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:29.212092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edaf3e-8f05-4d6a-9314-f893dabf11fa None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:29.213288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edaf3e-8f05-4d6a-9314-f893dabf11fa None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:29.215431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edaf3e-8f05-4d6a-9314-f893dabf11fa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:29.217212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 121/233] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:29 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:29.223209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:29.312004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:29.356161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46542095-6272-466d-aa27-48a63c8ef7f3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:29.397244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754b75e-0484-4c77-852e-db03a5a21edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:29.398092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b75e-0484-4c77-852e-db03a5a21edd None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:29.398373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b75e-0484-4c77-852e-db03a5a21edd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:29.398646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754b75e-0484-4c77-852e-db03a5a21edd None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/b41e1301ed5247d98c9385c3ae4bfefb/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:29.401031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754b75e-0484-4c77-852e-db03a5a21edd None admin] RBAC: Authorizing `identity:create_grant(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68, user_id=b41e1301ed5247d98c9385c3ae4bfefb, role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:29.402833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754b75e-0484-4c77-852e-db03a5a21edd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:29.422430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 113/234] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:29 2022] PUT /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/b41e1301ed5247d98c9385c3ae4bfefb/roles/e02cd49dfc6343ce87700207db79ff78 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:30.120212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3582b-9609-467a-9d53-cb7351d99678 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:30.120932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3582b-9609-467a-9d53-cb7351d99678 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:30.120932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3582b-9609-467a-9d53-cb7351d99678 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:30.122227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 122/235] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:30.129079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1723-07de-4f8e-a8ba-79816c08b21b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:30.130176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1723-07de-4f8e-a8ba-79816c08b21b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:30.130768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c1723-07de-4f8e-a8ba-79816c08b21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:30.155686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-756c1723-07de-4f8e-a8ba-79816c08b21b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:30.157277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-756c1723-07de-4f8e-a8ba-79816c08b21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:30.184102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16623ef5-9040-4434-8592-623742b3c6f3 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:30.184927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16623ef5-9040-4434-8592-623742b3c6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:30.185427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16623ef5-9040-4434-8592-623742b3c6f3 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:30.187737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 123/236] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:46:30.197546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cc11-0779-401e-8c7d-99586f6999dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:30.197826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cc11-0779-401e-8c7d-99586f6999dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:30.198102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48cc11-0779-401e-8c7d-99586f6999dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:30.217336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4c48cc11-0779-401e-8c7d-99586f6999dd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:30.218803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4c48cc11-0779-401e-8c7d-99586f6999dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:30.259366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 114/237] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:30.303735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 124/238] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:30.658510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c1723-07de-4f8e-a8ba-79816c08b21b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:30.669631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cc11-0779-401e-8c7d-99586f6999dd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:30.772373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:30.832491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c1723-07de-4f8e-a8ba-79816c08b21b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:30.851379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48cc11-0779-401e-8c7d-99586f6999dd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:30.863234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:30.872911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332398ef-36ee-4985-81d5-b8c029a6d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:30.873836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332398ef-36ee-4985-81d5-b8c029a6d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:30.874318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332398ef-36ee-4985-81d5-b8c029a6d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:30.874786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332398ef-36ee-4985-81d5-b8c029a6d5f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:30.887494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332398ef-36ee-4985-81d5-b8c029a6d5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:30.890294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:30.891108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:30.891524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:30.891934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:30.893215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-332398ef-36ee-4985-81d5-b8c029a6d5f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:30.893328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:30.894350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:30.895354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:30.897314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 115/239] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:30.897917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:30.898665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d9ee-7c81-432b-bba7-3023e187425f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:30.899020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d9ee-7c81-432b-bba7-3023e187425f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:30.899365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d9ee-7c81-432b-bba7-3023e187425f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:30.900262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 125/240] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:30.904997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 116/241] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:30.906185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:30.906609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d9ee-7c81-432b-bba7-3023e187425f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:31.015652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d9ee-7c81-432b-bba7-3023e187425f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:31.019335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b114a0f-c862-41fe-a86d-acbd4d76a2f4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:31.042752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:31.053518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:31.054403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.054864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.055307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.056189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:31.058362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:31.059651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20946dc2-f0f8-4a14-9c02-4d055991f5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:31.060357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946dc2-f0f8-4a14-9c02-4d055991f5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.060692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946dc2-f0f8-4a14-9c02-4d055991f5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.061020 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20946dc2-f0f8-4a14-9c02-4d055991f5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.061750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20946dc2-f0f8-4a14-9c02-4d055991f5e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:31.062140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20946dc2-f0f8-4a14-9c02-4d055991f5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:31.063545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20946dc2-f0f8-4a14-9c02-4d055991f5e8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:31.072335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 126/242] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:31.074363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47fd08-a20d-4183-aa99-b5fed0f23a18 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.074651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47fd08-a20d-4183-aa99-b5fed0f23a18 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.074925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47fd08-a20d-4183-aa99-b5fed0f23a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.092476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 117/243] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:46:30 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:31.093498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:31.100849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1a47fd08-a20d-4183-aa99-b5fed0f23a18 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:31.102066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1a47fd08-a20d-4183-aa99-b5fed0f23a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:31.176621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:31.259809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 127/244] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:31.265849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072c306-0158-4366-96c1-28c051654ec5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:31.306365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:31.307046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.307323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.307595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] PATH_INFO: `/v3/users/9067453d33294fcc8d72682bcc6e5c6f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.325523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] RBAC: Authorizing `identity:get_user(user_id=9067453d33294fcc8d72682bcc6e5c6f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:31.327164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:31.329334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 118/245] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:31 2022] GET /identity/v3/users/9067453d33294fcc8d72682bcc6e5c6f => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:31.335462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47fd08-a20d-4183-aa99-b5fed0f23a18 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:31.467292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47fd08-a20d-4183-aa99-b5fed0f23a18 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:31.503002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:31.503671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.503946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.504243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.542755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:31.578930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:31.580425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:31.588856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:31.659947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:31.739901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 128/246] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:31.746630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:31.767132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84de0e-79e0-4ac5-b4a5-27e1e18c9d15 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:31.831293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:31.832464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.833880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.835124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.856869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:31.859226 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:31.862292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:31.864101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:31.865883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 119/247] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:31.871127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:31.912769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c189e8-449c-46b8-90c1-9c9305638d08 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:31.961182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17aa809-59eb-485b-b54c-760e17eb56d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:31.961910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa809-59eb-485b-b54c-760e17eb56d4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.962241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa809-59eb-485b-b54c-760e17eb56d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.962614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17aa809-59eb-485b-b54c-760e17eb56d4 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.963753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aa809-59eb-485b-b54c-760e17eb56d4 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:31.966005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17aa809-59eb-485b-b54c-760e17eb56d4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:31.967901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 129/248] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:31 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:31.968929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ab977-9ae5-487c-b4fa-244a972932f6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:31.969206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ab977-9ae5-487c-b4fa-244a972932f6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:31.969480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ab977-9ae5-487c-b4fa-244a972932f6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:31.970969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 130/249] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:31.979074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ab977-9ae5-487c-b4fa-244a972932f6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:32.024484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:32.037163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c1e87-8ff2-4cfa-a274-b8505a548216 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:32.088046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c55a5-b78a-49bb-aed8-49e463de33b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:32.088688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c55a5-b78a-49bb-aed8-49e463de33b0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:32.089889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c55a5-b78a-49bb-aed8-49e463de33b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:32.090276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c55a5-b78a-49bb-aed8-49e463de33b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:32.090964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c55a5-b78a-49bb-aed8-49e463de33b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:32.091269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c55a5-b78a-49bb-aed8-49e463de33b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:32.092728 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7c55a5-b78a-49bb-aed8-49e463de33b0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:32.109542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 120/250] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:32.109542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc79ec-da07-48cc-bf3f-9a8ac61b48df None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:32.109542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc79ec-da07-48cc-bf3f-9a8ac61b48df None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:32.109542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc79ec-da07-48cc-bf3f-9a8ac61b48df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:32.128913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b9cc79ec-da07-48cc-bf3f-9a8ac61b48df None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:32.130483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b9cc79ec-da07-48cc-bf3f-9a8ac61b48df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:32.176060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ab977-9ae5-487c-b4fa-244a972932f6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:32.242015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 121/251] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:32.243674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb54f7-a27b-4ba5-abdc-c24eeafb5b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:32.245814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc79ec-da07-48cc-bf3f-9a8ac61b48df None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:32.246139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb54f7-a27b-4ba5-abdc-c24eeafb5b90 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:32.246631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb54f7-a27b-4ba5-abdc-c24eeafb5b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:32.247092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb54f7-a27b-4ba5-abdc-c24eeafb5b90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:32.248619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb54f7-a27b-4ba5-abdc-c24eeafb5b90 None admin] RBAC: Adding query filter params (role.id=c6a091ec4393414da501df193e374be8, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=9067453d33294fcc8d72682bcc6e5c6f) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:32.251218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb54f7-a27b-4ba5-abdc-c24eeafb5b90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:32.252948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb54f7-a27b-4ba5-abdc-c24eeafb5b90 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:32.263530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:32.280134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 131/252] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:31 2022] GET /identity/v3/role_assignments?user.id=9067453d33294fcc8d72682bcc6e5c6f&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=c6a091ec4393414da501df193e374be8 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:32.316051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16ad97-7028-48a7-941f-70a519b410ed None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:32.316051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16ad97-7028-48a7-941f-70a519b410ed None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:32.316051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16ad97-7028-48a7-941f-70a519b410ed None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:32.316540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 132/253] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:32.330192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11545-5b17-4a4b-8e0e-3a8c11fda8cb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:32.330496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11545-5b17-4a4b-8e0e-3a8c11fda8cb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:32.330736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11545-5b17-4a4b-8e0e-3a8c11fda8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:32.371838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-30e11545-5b17-4a4b-8e0e-3a8c11fda8cb None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:32.371838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-30e11545-5b17-4a4b-8e0e-3a8c11fda8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:32.388790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:32.422654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc79ec-da07-48cc-bf3f-9a8ac61b48df None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:32.529195 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:32.529861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:32.530213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:32.530394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] PATH_INFO: `/v3/users/0eee82133bcf403eb3e911af1b53ae92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:32.531601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] RBAC: Authorizing `identity:get_user(user_id=0eee82133bcf403eb3e911af1b53ae92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:32.533134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:32.535114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 122/254] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:32 2022] GET /identity/v3/users/0eee82133bcf403eb3e911af1b53ae92 => generated 297 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:32.545090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:32.550723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 133/255] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:32.708608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c9e4c-657d-4e74-b194-01f941625682 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:32.752314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11545-5b17-4a4b-8e0e-3a8c11fda8cb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:32.766843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:32.767494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:32.767771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:32.768064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:32.769619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:32.771084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:32.773066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 123/256] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:32 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:32.780938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:32.820885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:32.985956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c068c2-5f3a-4e6f-8db2-2dc5adef302d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:33.032539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11545-5b17-4a4b-8e0e-3a8c11fda8cb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:33.069401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:33.070077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:33.070356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:33.071636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/0eee82133bcf403eb3e911af1b53ae92/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:33.077672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68, user_id=0eee82133bcf403eb3e911af1b53ae92, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:33.079144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:33.102407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:33.107557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 124/257] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:32 2022] PUT /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/0eee82133bcf403eb3e911af1b53ae92/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:46:33.116080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:33.116750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:33.117025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:33.117293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:33.133213 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:33.139634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:33.141887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:33.143462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 134/258] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:33.157293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:33.283080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:33.289659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:33.347216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd9d92-e293-47b0-9162-eaa864fc6c56 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:33.462089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:33.463125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:33.463125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:33.463361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:33.465055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:33.465055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:33.466241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:33.477860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 125/259] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:33.487943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:33.554090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b2710-32f6-4bd9-ab76-539c312843e2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:33.650459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16410a40-c39c-4c2d-a25a-8894e0326438 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:33.655847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:33.656529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:33.656807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:33.657076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:33.685566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:33.690645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:33.691601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:33.692414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:33.697785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 135/260] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:33.710363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:33.744216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:33.744874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:33.745223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:33.745646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] PATH_INFO: `/v3/users/b41e1301ed5247d98c9385c3ae4bfefb` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:33.749770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] RBAC: Authorizing `identity:get_user(user_id=b41e1301ed5247d98c9385c3ae4bfefb)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:33.751270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:33.752966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 126/261] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:33 2022] GET /identity/v3/users/b41e1301ed5247d98c9385c3ae4bfefb => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:33.759143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:33.788326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:33.803382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:33.899101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693af25-8941-4544-a8c7-4a5bb20e66da None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:33.955445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:33.956120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:33.956469 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:33.956706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:33.957340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:33.957650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:33.959043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:33.959474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6ce50-47b9-4ba0-ac4d-783b797e8bab None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:33.977278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 136/262] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:33.984259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:34.039141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:34.040207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:34.040803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:34.041534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:34.178569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c5c94-70a2-41f4-9e13-803ffdca6388 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:34.197029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:34.220917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:34.222469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:34.251852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:34.265675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:34.267769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:34.268830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:34.272146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] PATH_INFO: `/v3/users/b41e1301ed5247d98c9385c3ae4bfefb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:34.277438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] RBAC: Authorizing `identity:get_user(user_id=b41e1301ed5247d98c9385c3ae4bfefb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:34.282937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:34.289854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 137/263] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:33 2022] GET /identity/v3/users/b41e1301ed5247d98c9385c3ae4bfefb => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:34.299737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:34.533112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 127/264] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:34.543611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:34.638130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ece8d1-3edd-46b7-b844-d2eb7788abc3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:34.760949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9525a48-058e-4df1-89bc-d88d76f96751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:34.761778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9525a48-058e-4df1-89bc-d88d76f96751 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:34.762061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9525a48-058e-4df1-89bc-d88d76f96751 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:34.762335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9525a48-058e-4df1-89bc-d88d76f96751 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:34.788432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305da9b-df77-41a4-96c0-94a2cfa1ba3e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:34.817267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:34.873898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:34.874559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:34.874896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:34.875178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:34.876422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:34.877903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:34.879873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 128/265] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:34 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:34.887477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:34.897872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:34.938872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9525a48-058e-4df1-89bc-d88d76f96751 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:34.938872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9525a48-058e-4df1-89bc-d88d76f96751 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:35.121285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655a18-34ce-46e1-b72f-afc456900029 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:35.135055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 138/266] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:35.136460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8fd8-53d3-43d4-88b4-17b240e2fb87 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:35.136760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8fd8-53d3-43d4-88b4-17b240e2fb87 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:35.137010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c8fd8-53d3-43d4-88b4-17b240e2fb87 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:35.138618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 139/267] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:35.140195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8fd8-53d3-43d4-88b4-17b240e2fb87 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:35.199704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750c469-bc74-4344-b343-99bb28746ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:35.201465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c469-bc74-4344-b343-99bb28746ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:35.204182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c469-bc74-4344-b343-99bb28746ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:35.205205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750c469-bc74-4344-b343-99bb28746ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:35.208701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c469-bc74-4344-b343-99bb28746ff4 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=b41e1301ed5247d98c9385c3ae4bfefb) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:35.209828 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c469-bc74-4344-b343-99bb28746ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:35.214096 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750c469-bc74-4344-b343-99bb28746ff4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:35.232049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 129/268] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:34 2022] GET /identity/v3/role_assignments?user.id=b41e1301ed5247d98c9385c3ae4bfefb&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:35.232049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ef14-2724-4e95-bb10-ba02fd68a429 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:35.232049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ef14-2724-4e95-bb10-ba02fd68a429 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:35.232049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ef14-2724-4e95-bb10-ba02fd68a429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:35.251534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6b64ef14-2724-4e95-bb10-ba02fd68a429 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:35.252925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6b64ef14-2724-4e95-bb10-ba02fd68a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:35.325558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:35.352534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:35.371400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c8fd8-53d3-43d4-88b4-17b240e2fb87 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:35.409808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 130/269] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:35.411452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2bf99-09f8-44b3-883c-fe41b7feb1af None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:35.411736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2bf99-09f8-44b3-883c-fe41b7feb1af None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:35.412092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2bf99-09f8-44b3-883c-fe41b7feb1af None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:35.413746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 131/270] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:35.418516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:35.420351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc67f-e42d-4795-8ad3-847abe1d5f53 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:35.420926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc67f-e42d-4795-8ad3-847abe1d5f53 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:35.421395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bcc67f-e42d-4795-8ad3-847abe1d5f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:35.425265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:35.425880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:35.426372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:35.427904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:35.430124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:35.433005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 140/271] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:35 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:35.440048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:35.469251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-78bcc67f-e42d-4795-8ad3-847abe1d5f53 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:35.471108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-78bcc67f-e42d-4795-8ad3-847abe1d5f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:35.578604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817edcbe-a2fe-47d4-9496-9abe10c5b409 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:35.631932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:35.634280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:35.634759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:35.635230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:35.637198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] RBAC: Adding query filter params (role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=b41e1301ed5247d98c9385c3ae4bfefb) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:35.637734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:35.641589 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:35.657416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 141/272] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:35 2022] GET /identity/v3/role_assignments?user.id=b41e1301ed5247d98c9385c3ae4bfefb&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:35.704838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 132/273] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:35.870076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:35.904929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:36.080844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc67f-e42d-4795-8ad3-847abe1d5f53 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:36.087157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49abbc-301b-4398-bbc7-a57678567a85 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:36.166260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:36.170227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.170564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.170848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.188531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:36.194082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:36.195050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:36.195860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 142/274] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:36.203810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:36.259190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bcc67f-e42d-4795-8ad3-847abe1d5f53 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:36.261555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:36.291199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:36.304290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09cff0-b65a-4fc9-b53e-606f32fc9048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:36.304939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09cff0-b65a-4fc9-b53e-606f32fc9048 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.305217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09cff0-b65a-4fc9-b53e-606f32fc9048 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.305486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09cff0-b65a-4fc9-b53e-606f32fc9048 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.306630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09cff0-b65a-4fc9-b53e-606f32fc9048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:36.308730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09cff0-b65a-4fc9-b53e-606f32fc9048 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:36.310502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 133/275] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:36.311498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3748bb-72ee-47da-b081-28d19b61021e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.311783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3748bb-72ee-47da-b081-28d19b61021e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.312231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3748bb-72ee-47da-b081-28d19b61021e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.313452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 134/276] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:36.318750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773ef3-d05f-4fd3-ba55-9250c4a4444a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.319035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773ef3-d05f-4fd3-ba55-9250c4a4444a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.319311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773ef3-d05f-4fd3-ba55-9250c4a4444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.340695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b4773ef3-d05f-4fd3-ba55-9250c4a4444a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:36.341732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a8b08-0227-4b8a-9ee1-682ea84aba1f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:36.341896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b4773ef3-d05f-4fd3-ba55-9250c4a4444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:36.397467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:36.398671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.398994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.399450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.400254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:36.400594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:36.403102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:36.413210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 143/277] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:36.413989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:36.448171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 135/278] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:36.448171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773ef3-d05f-4fd3-ba55-9250c4a4444a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:36.551600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7daca95-5a2f-47c3-9f41-c9e0c7a19e3c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:36.567353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:36.574082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773ef3-d05f-4fd3-ba55-9250c4a4444a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:36.594609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:36.595385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.595784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.596081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.596814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:36.598269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:36.607832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:36.631037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:36.631037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.631037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.631037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] PATH_INFO: `/v3/users/c96b2868c18b431bac3dffc78fefca76` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.631650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 144/279] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:46:36 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:36.668716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] RBAC: Authorizing `identity:get_user(user_id=c96b2868c18b431bac3dffc78fefca76)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:36.671542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:36.675436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 136/280] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:36 2022] GET /identity/v3/users/c96b2868c18b431bac3dffc78fefca76 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:36.681423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:36.740265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:36.819939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96be7-a4f2-4928-a7df-492006093cfe None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:36.864674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33df88-8e6c-4af7-912c-cbdfb3bfff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:36.865676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33df88-8e6c-4af7-912c-cbdfb3bfff6c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.865956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33df88-8e6c-4af7-912c-cbdfb3bfff6c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.866231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33df88-8e6c-4af7-912c-cbdfb3bfff6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.868074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33df88-8e6c-4af7-912c-cbdfb3bfff6c None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, user.id=c96b2868c18b431bac3dffc78fefca76, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:36.868074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33df88-8e6c-4af7-912c-cbdfb3bfff6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:36.868766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33df88-8e6c-4af7-912c-cbdfb3bfff6c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:36.874870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 145/281] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Sep 14 12:46:36 2022] GET /identity/v3/role_assignments?user.id=c96b2868c18b431bac3dffc78fefca76&scope.system=all&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:36.880044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0e999-3038-4808-acd2-818c14739bda None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.880044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0e999-3038-4808-acd2-818c14739bda None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.880044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0e999-3038-4808-acd2-818c14739bda None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.880044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 146/282] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:36.884307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcd88-f3aa-4108-8049-d6982b0b8a94 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.884650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcd88-f3aa-4108-8049-d6982b0b8a94 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.884929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bcd88-f3aa-4108-8049-d6982b0b8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.886939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eefe0-ee3a-4982-88f5-d6c2e6c0493d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:36.906032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8d3bcd88-f3aa-4108-8049-d6982b0b8a94 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:36.907279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8d3bcd88-f3aa-4108-8049-d6982b0b8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:36.945445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:36.946886 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:36.947166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:36.947608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:36.965002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:36.972050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:36.973009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:36.973821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:36.974435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 137/283] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:36.978301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:36.982375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:37.021021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 147/284] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:37.027842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:37.152833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff4d0b-416b-433b-a931-a9aa823276e3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:37.210574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:37.211199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:37.211479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:37.211754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:37.212470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:37.212775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:37.214759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:37.224647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 138/285] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:37.232315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bcd88-f3aa-4108-8049-d6982b0b8a94 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:37.324278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:37.361495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bcd88-f3aa-4108-8049-d6982b0b8a94 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:37.452664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:37.453298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:37.453578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:37.453849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] PATH_INFO: `/v3/users/9067453d33294fcc8d72682bcc6e5c6f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:37.456229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] RBAC: Authorizing `identity:get_user(user_id=9067453d33294fcc8d72682bcc6e5c6f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:37.458053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:37.460252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 148/286] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:37 2022] GET /identity/v3/users/9067453d33294fcc8d72682bcc6e5c6f => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:37.471049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:37.561215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:37.608306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b37a1-c601-469c-af54-90155cd0f6fc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:37.645037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:37.681063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:37.682114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:37.682615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:37.683575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:37.710586 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:37.722523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:37.724265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:37.725780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:37.730926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 139/287] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:37.737129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:37.775568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba222e2-b340-4226-8a8d-74777d80f28b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:37.881295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:37.881960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:37.882236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:37.882514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:37.883690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:37.885186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:37.896690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 149/288] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:37 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:37.911672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:37.997825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05626fd8-6c92-4059-94c0-d5b0db5d8512 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:38.062865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:38.063881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:38.064570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:38.065068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:38.066451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:38.067004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:38.070432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:38.088291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 140/289] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:38.097113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:38.110069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:38.137442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b2b28-cae3-4029-bbb2-e450f510093d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:38.175850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:38.209764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:38.210442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:38.210713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:38.210983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/9067453d33294fcc8d72682bcc6e5c6f/roles/c6a091ec4393414da501df193e374be8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:38.214997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] RBAC: Authorizing `identity:create_grant(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68, user_id=9067453d33294fcc8d72682bcc6e5c6f, role_id=c6a091ec4393414da501df193e374be8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:38.217572 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:38.263647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 150/290] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:46:37 2022] PUT /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/users/9067453d33294fcc8d72682bcc6e5c6f/roles/c6a091ec4393414da501df193e374be8 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:46:38.288850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8cf72-74be-4821-9021-1f594fd3d2ae None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:38.330556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:38.331456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:38.331957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:38.332404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] PATH_INFO: `/v3/users/0eee82133bcf403eb3e911af1b53ae92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:38.333838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=0eee82133bcf403eb3e911af1b53ae92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:38.335550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:38.337391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 141/291] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:38 2022] GET /identity/v3/users/0eee82133bcf403eb3e911af1b53ae92 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:38.344396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:38.514251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5f9ec-f730-40f9-bc89-55bc74df524b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:38.577926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:38.578574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:38.578855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:38.579133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:38.641073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:38.666841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:38.668420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:38.793486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 151/292] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:38.798706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:38.884855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:38.923779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b41774-3f6f-41a9-abfe-32683c595bc8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:38.973515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e7a39-d1c2-474c-9ed7-b3c24a0c7b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:38.974157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e7a39-d1c2-474c-9ed7-b3c24a0c7b93 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:38.974436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e7a39-d1c2-474c-9ed7-b3c24a0c7b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:38.974714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e7a39-d1c2-474c-9ed7-b3c24a0c7b93 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:38.980919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e7a39-d1c2-474c-9ed7-b3c24a0c7b93 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:38.982427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e7a39-d1c2-474c-9ed7-b3c24a0c7b93 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:38.984546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 142/293] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:38 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:38.990092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:39.122430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:39.148456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aea1fb-d15f-40e3-975c-12b17aafe81a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:39.185346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7017d-ff66-4f4e-b43d-9ec58f2f7dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:39.186021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7017d-ff66-4f4e-b43d-9ec58f2f7dcf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:39.186299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7017d-ff66-4f4e-b43d-9ec58f2f7dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:39.186562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7017d-ff66-4f4e-b43d-9ec58f2f7dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:39.187339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7017d-ff66-4f4e-b43d-9ec58f2f7dcf None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=0eee82133bcf403eb3e911af1b53ae92) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:39.187646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7017d-ff66-4f4e-b43d-9ec58f2f7dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:39.189099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7017d-ff66-4f4e-b43d-9ec58f2f7dcf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:39.196145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 152/294] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:38 2022] GET /identity/v3/role_assignments?user.id=0eee82133bcf403eb3e911af1b53ae92&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:39.565123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5fcb-b517-4606-bcea-77f0fe300c25 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:39.565645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5fcb-b517-4606-bcea-77f0fe300c25 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:39.565645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5fcb-b517-4606-bcea-77f0fe300c25 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:39.567165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 143/295] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:39.576051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a99b7-a4a1-4e94-8f7c-4192251248d2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:39.576051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a99b7-a4a1-4e94-8f7c-4192251248d2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:39.576051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a99b7-a4a1-4e94-8f7c-4192251248d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:39.590906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb470da5-89ad-4498-9a06-d75ad55ffa91 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:39.591615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb470da5-89ad-4498-9a06-d75ad55ffa91 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:39.592123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb470da5-89ad-4498-9a06-d75ad55ffa91 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:39.594116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 144/296] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:39.596843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-636a99b7-a4a1-4e94-8f7c-4192251248d2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:39.598041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-636a99b7-a4a1-4e94-8f7c-4192251248d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:39.599500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e488ec-b319-4ec6-bac2-2bd58d154152 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:39.600063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e488ec-b319-4ec6-bac2-2bd58d154152 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:39.600564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e488ec-b319-4ec6-bac2-2bd58d154152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:39.631880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-39e488ec-b319-4ec6-bac2-2bd58d154152 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:39.633483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-39e488ec-b319-4ec6-bac2-2bd58d154152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:39.694492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 153/297] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:39.758940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 145/298] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:39.909698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f67c4-06d5-4726-9a3d-63eeec0add10 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:39.910061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f67c4-06d5-4726-9a3d-63eeec0add10 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:39.910251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f67c4-06d5-4726-9a3d-63eeec0add10 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:39.911875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 154/299] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:39.917460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe896cc8-f2f1-4a5e-b3c4-5ac3cefccabf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:39.917859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe896cc8-f2f1-4a5e-b3c4-5ac3cefccabf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:39.918230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe896cc8-f2f1-4a5e-b3c4-5ac3cefccabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:39.936951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fe896cc8-f2f1-4a5e-b3c4-5ac3cefccabf None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:39.938237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fe896cc8-f2f1-4a5e-b3c4-5ac3cefccabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:39.985794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f67c4-06d5-4726-9a3d-63eeec0add10 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.022869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.029201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 146/300] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:40.055790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe896cc8-f2f1-4a5e-b3c4-5ac3cefccabf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.094961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.132083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f67c4-06d5-4726-9a3d-63eeec0add10 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.171775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe896cc8-f2f1-4a5e-b3c4-5ac3cefccabf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.180978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.181679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.181962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.182235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.198661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:40.204618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:40.212365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 155/301] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:40.213205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.223350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.223999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.225139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.225422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.238396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:40.244760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:40.246558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:40.247370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 147/302] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:40.254059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.322502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.340925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5a9ef-6d35-4cd6-8d03-9407d4379b86 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.377057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e15c2-5dab-4a95-96b7-58e683cecd0a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.377475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.378094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.378370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.378642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.379335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:40.379640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:40.381120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:40.382625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.392114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 156/303] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:40.398607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.424644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.425181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.425522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.425715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.426421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:40.426672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:40.428139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:40.437663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 148/304] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:40.440920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.510059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e894f-e1f8-4f70-b6e5-0e3fe15de578 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.549638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.550267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd768817-14e7-4f66-95b1-0a835663d671 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.550378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.550561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.550816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.551932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:40.553468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:40.555244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 157/305] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:40.555857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.577433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.593764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.594398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.594676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.594949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] PATH_INFO: `/v3/users/238a017a454c46ddae152a5e38dd0068` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.609721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] RBAC: Authorizing `identity:get_user(user_id=238a017a454c46ddae152a5e38dd0068)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:40.611176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:40.613070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 149/306] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:40 2022] GET /identity/v3/users/238a017a454c46ddae152a5e38dd0068 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:40.618425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.643375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.693141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310301c-1b8f-4a7a-842f-be3a6138e34a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.727144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5f6cb-b836-4e66-aef4-eff9b0f6da27 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.737139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.737777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.738051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.738320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] PATH_INFO: `/v3/users/c96b2868c18b431bac3dffc78fefca76` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.739546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] RBAC: Authorizing `identity:get_user(user_id=c96b2868c18b431bac3dffc78fefca76)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:40.741121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:40.742834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 158/307] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:40 2022] GET /identity/v3/users/c96b2868c18b431bac3dffc78fefca76 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:40.743500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.775280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.776814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.777393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.777668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] PATH_INFO: `/v3/groups` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.778300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:40.779764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:40.804538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 150/308] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Sep 14 12:46:40 2022] POST /identity/v3/groups => generated 229 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:40.804538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:40.873261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ad06-cb0d-4205-bee9-41440a9ef850 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:40.896381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.919160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:40.926637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8c56f-9bff-4ee5-bf2d-66c88286adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:40.927232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c56f-9bff-4ee5-bf2d-66c88286adb7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:40.927926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c56f-9bff-4ee5-bf2d-66c88286adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:40.928348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c56f-9bff-4ee5-bf2d-66c88286adb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:40.929255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8c56f-9bff-4ee5-bf2d-66c88286adb7 None admin] RBAC: Adding query filter params (role.id=c6a091ec4393414da501df193e374be8, user.id=238a017a454c46ddae152a5e38dd0068, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:40.929647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8c56f-9bff-4ee5-bf2d-66c88286adb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:40.931318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8c56f-9bff-4ee5-bf2d-66c88286adb7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:40.938262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 159/309] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Sep 14 12:46:40 2022] GET /identity/v3/role_assignments?user.id=238a017a454c46ddae152a5e38dd0068&scope.system=all&role.id=c6a091ec4393414da501df193e374be8 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:41.026994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd52d0-079d-407b-ae43-65c52e69b119 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:41.057209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f33fe-bb3c-48e7-9ff3-c90968c0d2c9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:41.058388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f33fe-bb3c-48e7-9ff3-c90968c0d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:41.058696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f33fe-bb3c-48e7-9ff3-c90968c0d2c9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:41.060719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 160/310] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:41.066198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab781b9-2de6-489e-98df-47d96100dd4c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:41.066498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab781b9-2de6-489e-98df-47d96100dd4c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:41.066775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab781b9-2de6-489e-98df-47d96100dd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:41.091473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7ab781b9-2de6-489e-98df-47d96100dd4c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:41.092737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7ab781b9-2de6-489e-98df-47d96100dd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:41.095508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:41.097389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:41.097798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:41.097971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] PATH_INFO: `/v3/system/users/c96b2868c18b431bac3dffc78fefca76/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:41.099549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c96b2868c18b431bac3dffc78fefca76, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:41.101025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:41.115436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 151/311] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Sep 14 12:46:40 2022] PUT /identity/v3/system/users/c96b2868c18b431bac3dffc78fefca76/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:41.181202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 161/312] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:41.453878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:41.562555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad20dcb-16e3-4840-a8c6-58b272e8e30f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:41.564106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:41.601660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:41.602307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:41.602562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:41.602837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:41.614018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:41.618937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:41.620377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:41.622075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 152/313] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:41.626762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab781b9-2de6-489e-98df-47d96100dd4c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:41.732392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab781b9-2de6-489e-98df-47d96100dd4c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:41.764609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:41.774491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:41.775464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:41.775959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:41.777367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:41.778415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:41.778945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:41.780631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:41.790114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 162/314] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:41.800076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:41.913464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f727ba-f0a2-483a-aa83-d92dfb899ec4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:41.951499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:41.952611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:41.953043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:41.953467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] PATH_INFO: `/v3/users/9067453d33294fcc8d72682bcc6e5c6f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:41.954974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] RBAC: Authorizing `identity:get_user(user_id=9067453d33294fcc8d72682bcc6e5c6f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:41.956759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:41.959144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 153/315] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:41 2022] GET /identity/v3/users/9067453d33294fcc8d72682bcc6e5c6f => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:41.965965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:42.081001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38229147-d198-4ce4-bf7f-9e2c1b546cdb None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:42.117260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:42.117884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:42.118166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:42.118444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:42.177068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:42.190426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:42.191868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:42.298635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 163/316] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:42.304301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:42.339670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:42.419164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e6fdf-f7d6-43ba-b831-bc58939d774f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:42.461764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba399f74-59b0-4ee7-8c0f-83358dfc7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:42.462420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba399f74-59b0-4ee7-8c0f-83358dfc7225 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:42.462699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba399f74-59b0-4ee7-8c0f-83358dfc7225 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:42.462974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba399f74-59b0-4ee7-8c0f-83358dfc7225 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:42.464267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba399f74-59b0-4ee7-8c0f-83358dfc7225 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:42.465814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba399f74-59b0-4ee7-8c0f-83358dfc7225 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:42.467677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 154/317] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:42 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:42.473681 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:42.563904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:42.577154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54245dfb-69e8-4cf7-8b07-6e4e98d48951 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:42.612727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838455b-434a-4b38-804e-522d929c117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:42.613259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838455b-434a-4b38-804e-522d929c117a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:42.613541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838455b-434a-4b38-804e-522d929c117a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:42.613874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838455b-434a-4b38-804e-522d929c117a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:42.614605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838455b-434a-4b38-804e-522d929c117a None admin] RBAC: Adding query filter params (role.id=c6a091ec4393414da501df193e374be8, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68, user.id=9067453d33294fcc8d72682bcc6e5c6f) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:42.614912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838455b-434a-4b38-804e-522d929c117a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:42.616368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838455b-434a-4b38-804e-522d929c117a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:42.622822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 164/318] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:46:42 2022] GET /identity/v3/role_assignments?user.id=9067453d33294fcc8d72682bcc6e5c6f&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=c6a091ec4393414da501df193e374be8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:43.228545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e2712-65be-4e5a-8c39-b902a374be12 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.229134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e2712-65be-4e5a-8c39-b902a374be12 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.229134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e2712-65be-4e5a-8c39-b902a374be12 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.231431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 155/319] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:43.237543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371f68-4c3b-4edd-bfbb-89edd5aeba4b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.238110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371f68-4c3b-4edd-bfbb-89edd5aeba4b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.238110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70371f68-4c3b-4edd-bfbb-89edd5aeba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.264448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-70371f68-4c3b-4edd-bfbb-89edd5aeba4b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:43.265647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-70371f68-4c3b-4edd-bfbb-89edd5aeba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:43.341309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 165/320] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:43.348367 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9f61-2e18-46ff-a516-4cda4f2d914f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.348654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9f61-2e18-46ff-a516-4cda4f2d914f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.348921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf9f61-2e18-46ff-a516-4cda4f2d914f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.350352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 156/321] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:43.355375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1ef6-983f-44a6-b1e3-e49720b021f6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.355660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1ef6-983f-44a6-b1e3-e49720b021f6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.355936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d1ef6-983f-44a6-b1e3-e49720b021f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.360505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127689f4-4226-43be-b26c-3f415c280b20 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.360889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127689f4-4226-43be-b26c-3f415c280b20 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.361091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127689f4-4226-43be-b26c-3f415c280b20 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.362587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 157/322] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:46:43.367707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c09a08-702c-40fe-aed3-9e4ddc5c9ca2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.367997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c09a08-702c-40fe-aed3-9e4ddc5c9ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.368341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c09a08-702c-40fe-aed3-9e4ddc5c9ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.375205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-289d1ef6-983f-44a6-b1e3-e49720b021f6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:43.376413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-289d1ef6-983f-44a6-b1e3-e49720b021f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:43.387110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b8c09a08-702c-40fe-aed3-9e4ddc5c9ca2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:43.388342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b8c09a08-702c-40fe-aed3-9e4ddc5c9ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:43.452639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 166/323] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:43.462358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 158/324] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:43.610263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d1ef6-983f-44a6-b1e3-e49720b021f6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:43.625525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:43.717025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d1ef6-983f-44a6-b1e3-e49720b021f6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:43.726584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c09a08-702c-40fe-aed3-9e4ddc5c9ca2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:43.755066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:43.755703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.755841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:43.755993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.756303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.767564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:43.772408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:43.773299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 167/325] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:43.774925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:43.832661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c09a08-702c-40fe-aed3-9e4ddc5c9ca2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:43.847075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:43.866966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:43.867510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.867789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.868082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.869187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:43.871554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:43.873133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 159/326] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:43.873891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:43.879932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32872914-a762-453a-bb07-6f25d88b02e3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:43.914787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:43.915410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:43.915685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:43.915951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:43.926719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:43.931562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:43.933132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:43.933926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:43.936182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 168/327] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:43.937044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:43.975409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:43.982416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169ac9e-fdd5-4fa4-8158-d957fa27657e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:44.017739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:44.018345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:44.018626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:44.018899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:44.019560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:44.019864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:44.021286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:44.029593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 160/328] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:44.029593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:44.048982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19976e-fa33-4bc7-b06a-459c12065a1c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:44.081278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:44.086875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:44.087488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:44.087768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:44.088059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] PATH_INFO: `/v3/groups` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:44.088866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:44.090289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:44.107391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 169/329] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Sep 14 12:46:43 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:46:44.108040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:44.167502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eed01e-3ec2-4efc-947a-b7f99c8fb80b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:44.207491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:44.208132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:44.208412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:44.208682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:44.209356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:44.209659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:44.211030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:44.225100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 161/330] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:44.226430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:44.231902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a2ce0-5a9a-4e76-9277-771fa988a792 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:44.255047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:44.272250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:44.272900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:44.273180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:44.273447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] PATH_INFO: `/v3/users/238a017a454c46ddae152a5e38dd0068` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:44.274620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] RBAC: Authorizing `identity:get_user(user_id=238a017a454c46ddae152a5e38dd0068)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:44.276176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:44.278091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 170/331] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:44 2022] GET /identity/v3/users/238a017a454c46ddae152a5e38dd0068 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:44.283794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:44.361569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:44.366114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1f0b0-489e-4f55-80df-a5cefe82ad74 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:44.420935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:44.421559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:44.421844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:44.422124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] PATH_INFO: `/v3/users/c96b2868c18b431bac3dffc78fefca76` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:44.424084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] RBAC: Authorizing `identity:get_user(user_id=c96b2868c18b431bac3dffc78fefca76)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:44.425645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:44.425891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f112a3-d1d6-4f4d-b940-8b52184e67a1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:44.427602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 162/332] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:44 2022] GET /identity/v3/users/c96b2868c18b431bac3dffc78fefca76 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:44.434697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:44.474529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd8830-a35f-4908-9d2f-d078afc54496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:44.475208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8830-a35f-4908-9d2f-d078afc54496 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:44.475490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8830-a35f-4908-9d2f-d078afc54496 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:44.475775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd8830-a35f-4908-9d2f-d078afc54496 None admin] PATH_INFO: `/v3/system/users/238a017a454c46ddae152a5e38dd0068/roles/c6a091ec4393414da501df193e374be8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:44.478676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd8830-a35f-4908-9d2f-d078afc54496 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=238a017a454c46ddae152a5e38dd0068, role_id=c6a091ec4393414da501df193e374be8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:44.482300 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd8830-a35f-4908-9d2f-d078afc54496 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:44.500975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 171/333] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Sep 14 12:46:44 2022] PUT /identity/v3/system/users/238a017a454c46ddae152a5e38dd0068/roles/c6a091ec4393414da501df193e374be8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:46:44.560473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:44.577823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57472e6c-9823-4238-a31f-d0ae17f6b5b7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:44.625176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170002-17f0-4b95-a4e3-79a22b00a5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:44.625176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170002-17f0-4b95-a4e3-79a22b00a5fe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:44.625176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170002-17f0-4b95-a4e3-79a22b00a5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:44.625176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170002-17f0-4b95-a4e3-79a22b00a5fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:44.625562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170002-17f0-4b95-a4e3-79a22b00a5fe None admin] RBAC: Adding query filter params (role.id=f325e8ec498a48e3a4eb22e6e65148f9, user.id=c96b2868c18b431bac3dffc78fefca76, scope.system=all) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:44.625799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170002-17f0-4b95-a4e3-79a22b00a5fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:44.627270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4170002-17f0-4b95-a4e3-79a22b00a5fe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:44.642940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 163/334] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Sep 14 12:46:44 2022] GET /identity/v3/role_assignments?user.id=c96b2868c18b431bac3dffc78fefca76&scope.system=all&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:46.976381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6241-7176-4e90-8c95-c4855a9b8271 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:46.977395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6241-7176-4e90-8c95-c4855a9b8271 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:46.977888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e6241-7176-4e90-8c95-c4855a9b8271 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:46.980717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 172/335] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:46.989622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560b52-5c8d-42b4-ab51-f84b14a52f99 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:46.990565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560b52-5c8d-42b4-ab51-f84b14a52f99 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:46.991021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560b52-5c8d-42b4-ab51-f84b14a52f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.017422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d4560b52-5c8d-42b4-ab51-f84b14a52f99 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:47.018955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4560b52-5c8d-42b4-ab51-f84b14a52f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:47.112573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 164/336] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:47.248652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5604b7-b271-4f3a-a748-f3dc8dddbc64 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:47.249193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5604b7-b271-4f3a-a748-f3dc8dddbc64 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:47.249645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5604b7-b271-4f3a-a748-f3dc8dddbc64 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.251377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 173/337] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:47.257238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c7297-244e-4723-9adb-51d3c1f63bc7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:47.257751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c7297-244e-4723-9adb-51d3c1f63bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:47.258203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c7297-244e-4723-9adb-51d3c1f63bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.272107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec877b1-901f-44fc-a43e-06b814c2e33f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:47.272693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec877b1-901f-44fc-a43e-06b814c2e33f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:47.273136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec877b1-901f-44fc-a43e-06b814c2e33f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.274634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 174/338] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:46:47.280252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b116-f02f-4d83-9359-238e23e13206 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:47.280790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b116-f02f-4d83-9359-238e23e13206 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:47.281241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0b116-f02f-4d83-9359-238e23e13206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.298745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f64c7297-244e-4723-9adb-51d3c1f63bc7 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:47.301344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f64c7297-244e-4723-9adb-51d3c1f63bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:47.308546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-89c0b116-f02f-4d83-9359-238e23e13206 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:47.314461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-89c0b116-f02f-4d83-9359-238e23e13206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:47.460125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 165/339] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:47.461938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c7297-244e-4723-9adb-51d3c1f63bc7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:47.475028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:47.482032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 175/340] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:47.572932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586eb02-b945-4851-8f4f-578bfae71acb None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:47.573226 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586eb02-b945-4851-8f4f-578bfae71acb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:47.573491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586eb02-b945-4851-8f4f-578bfae71acb None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.575111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 176/341] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:47.585145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc4f7-9c82-4289-8dfb-742838677ac3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:47.585440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc4f7-9c82-4289-8dfb-742838677ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:47.585688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dc4f7-9c82-4289-8dfb-742838677ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.617438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b67dc4f7-9c82-4289-8dfb-742838677ac3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:47.618347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b67dc4f7-9c82-4289-8dfb-742838677ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:47.663761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c7297-244e-4723-9adb-51d3c1f63bc7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:47.694743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:47.726561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 177/342] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:47.756804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:47.757740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:47.758172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:47.758583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:47.785188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:47.790807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:47.792050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:47.793061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:47.795435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 166/343] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:47.801054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dc4f7-9c82-4289-8dfb-742838677ac3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:47.869049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:47.960282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dc4f7-9c82-4289-8dfb-742838677ac3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.005889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.049229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.050301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.050798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.051292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.052625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:48.053444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:48.056306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:48.076911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 178/344] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:48.078726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.082009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d76c3c-0782-4022-a88c-b242e242fd64 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.151623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.152990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.153420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.153853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.169930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.176334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:48.188755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:48.190741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 167/345] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:48.197172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.255647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f90831-fc22-4218-8928-dd4dd4b84fa3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.293766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.295149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.295680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.296359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.309314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:48.315069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:48.315999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 14 12:46:48.316839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:48.319137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 179/346] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:48.320245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.382266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4cba5-1e05-4afd-91ad-1cf33c71ec61 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.420512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.425817 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.427063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.427737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.428964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.437399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1efaf4d-172f-42e6-9c45-7fbcedbd0892 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.444606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.481809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.482747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.483187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.483624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.500924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:48.506164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:48.506386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:48.507428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:48.508434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 180/347] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:48.511423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:48.512278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.628176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 168/348] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:48.629367 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.639746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d379a62-7cee-467f-ab5b-b24e4cf32dbe None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.662560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.677596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.678455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.678884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.679315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.680172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:48.680646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:48.682746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:48.691790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 181/349] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:48.693035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.726872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.754113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005dd76-3061-4c81-b766-f995ed9549a1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.792530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.793474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.793896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.794309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.795118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:48.795572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:48.798319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:48.808196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 169/350] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:48.809264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.812376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db15ad-a02c-4967-9e6f-f84c5d4ad8fd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.849596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.850577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.851073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.851556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.852460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:48.852988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:48.855120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:48.865319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 182/351] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:48.866457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:48.913599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.931178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1deb7-78bf-4c7f-9f55-fc64badbd97a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:48.979819 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:48.981146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:48.981424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:48.981697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:48.983440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:48.985507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:48.987046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:48.988441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 170/352] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:48.989693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:49.000986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f232e-d94d-4c94-be35-6bf96ec3d81f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:49.049614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95770f-bbb6-460c-8943-62850753afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:49.050256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95770f-bbb6-460c-8943-62850753afc9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.050546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95770f-bbb6-460c-8943-62850753afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.050814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95770f-bbb6-460c-8943-62850753afc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.135819 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9d32a-a40a-4d4a-99bc-97306d40795a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:49.155196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95770f-bbb6-460c-8943-62850753afc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:49.156711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95770f-bbb6-460c-8943-62850753afc9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:49.192738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:49.193644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.193926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.194196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] PATH_INFO: `/v3/users/238a017a454c46ddae152a5e38dd0068` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.195637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=238a017a454c46ddae152a5e38dd0068)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:49.198450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:49.200491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 171/353] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/users/238a017a454c46ddae152a5e38dd0068 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:49.201268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:49.229597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:49.295116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:49.307415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 183/354] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:49.309119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396097-a3cb-463b-be2b-bf9c56c27dad None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.309629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396097-a3cb-463b-be2b-bf9c56c27dad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.310093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396097-a3cb-463b-be2b-bf9c56c27dad None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.311580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 184/355] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:49.312487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396097-a3cb-463b-be2b-bf9c56c27dad None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:49.340262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57416a7f-3adc-43c6-8e2a-53a1319ab3a9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:49.386810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93653d-523f-43d2-8f1c-d5492b776119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:49.387431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93653d-523f-43d2-8f1c-d5492b776119 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.387721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93653d-523f-43d2-8f1c-d5492b776119 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.387999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93653d-523f-43d2-8f1c-d5492b776119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.448267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396097-a3cb-463b-be2b-bf9c56c27dad None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:49.482386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93653d-523f-43d2-8f1c-d5492b776119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:49.483420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93653d-523f-43d2-8f1c-d5492b776119 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:49.488581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:49.489216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.489498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.489765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.498528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:49.499992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:49.501809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 185/356] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:49 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:49.502589 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:49.516106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:49.575612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:49.612910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 172/357] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:49.614519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890bf4-9722-4fdd-8848-3d8428d20296 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.614797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890bf4-9722-4fdd-8848-3d8428d20296 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.615065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890bf4-9722-4fdd-8848-3d8428d20296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.638541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-61890bf4-9722-4fdd-8848-3d8428d20296 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:49.640202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-61890bf4-9722-4fdd-8848-3d8428d20296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:49.645327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46fa60-3541-45f5-a7d9-7147c45857d5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:49.688102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:49.688726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.689006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.689279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.690473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] RBAC: Adding query filter params (role.id=c6a091ec4393414da501df193e374be8, user.id=238a017a454c46ddae152a5e38dd0068, scope.system=all) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:49.690812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:49.692659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:49.707793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 186/358] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Sep 14 12:46:49 2022] GET /identity/v3/role_assignments?user.id=238a017a454c46ddae152a5e38dd0068&scope.system=all&role.id=c6a091ec4393414da501df193e374be8 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:49.711018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:49.736164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 173/359] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:49.737556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7541efa-c01f-4ec9-8396-00d7596fce32 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.737838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7541efa-c01f-4ec9-8396-00d7596fce32 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.738938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7541efa-c01f-4ec9-8396-00d7596fce32 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.740856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 174/360] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:49.742007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7541efa-c01f-4ec9-8396-00d7596fce32 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:49.820457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:49.846511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd1f86-9ab5-4028-94db-bb91220a1c12 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:49.867446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:49.881624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7541efa-c01f-4ec9-8396-00d7596fce32 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:49.895942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:49.897347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.898070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.898521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.900834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:49.902796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:49.904921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 187/361] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:49 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:49.905742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:49.930704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2c8ab-af22-48af-8d0c-aae9884ab590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:49.931740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c8ab-af22-48af-8d0c-aae9884ab590 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.932900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c8ab-af22-48af-8d0c-aae9884ab590 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.933355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2c8ab-af22-48af-8d0c-aae9884ab590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.934373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2c8ab-af22-48af-8d0c-aae9884ab590 None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:49.934682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2c8ab-af22-48af-8d0c-aae9884ab590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:49.937147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab2c8ab-af22-48af-8d0c-aae9884ab590 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:49.944695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 175/362] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:46:49 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:49.946237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018f5d8-6fd4-46a7-8e1d-942917fb411e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:49.946748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018f5d8-6fd4-46a7-8e1d-942917fb411e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:49.947163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018f5d8-6fd4-46a7-8e1d-942917fb411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:49.970184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a018f5d8-6fd4-46a7-8e1d-942917fb411e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:49.971670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a018f5d8-6fd4-46a7-8e1d-942917fb411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:50.042557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004881c0-c1ca-4aa2-82df-298b52dfb155 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.081669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 176/363] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:50.083628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018f5d8-6fd4-46a7-8e1d-942917fb411e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.094630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.095960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.096425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.096865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.098457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:50.100253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:50.102262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 188/364] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:49 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:50.110609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.197268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:50.197837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:50.273351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be4ceb-56c6-4def-adad-a13e3a31e9d5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.294107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018f5d8-6fd4-46a7-8e1d-942917fb411e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.336873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.337772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.339481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.339984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.341431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:50.343037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:50.345454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 189/365] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:50.346498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.357169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.357831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.358113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.358389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.359556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:50.361153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:50.363039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 177/366] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:50.364162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.474763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff30c43-7f03-440b-97ea-29e6ea9e825c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.498744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b7fb4-4829-454f-96a5-c7bff0b8f321 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.501981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:50.528924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.529814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.530416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.530416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.538069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:50.546345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:50.552739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:50.553898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:50.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:50.556116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 190/367] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:50.557756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.562425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.563359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.563903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.564234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.564968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:50.565446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:50.567045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:50.574177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 178/368] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:50.575029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.690481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91004eb4-a026-469a-82d5-6cf70fe8b037 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.712846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcb3f2-acb0-4c6a-a2fa-43405b7c69b6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.732799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.733822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.734305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.734782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.749734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:50.755308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:50.756647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:50.757434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:50.761143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 179/369] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:50.761375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.763349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.763982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.764285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.764561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.765297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:50.765600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:50.767307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:50.782719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 191/370] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:50.785986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:50.840409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:50.878161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:50.923911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d2bf0-9a1e-4ca1-89ab-fabc1459cae0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:50.964633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:50.965609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:50.966119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:50.966605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:50.967497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:50.968108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:50.969951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:50.980906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 180/371] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:50.986504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:51.008052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33398373-bb6e-49da-9835-b2c614491063 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:51.062261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:51.062821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:51.063099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:51.063374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:51.064081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:51.064392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:51.065822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:51.087765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 192/372] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:51.101833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:51.151439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272e315-31c5-4c9e-aaca-c471099fa00e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:51.155576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:51.246165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:51.246811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:51.247052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:51.247329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:51.255505 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371a5f3-d124-41cc-913d-a01312ca6281 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:51.259017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:51.299283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:51.299901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:51.300213 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:51.300487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:51.376332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:51.377838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:51.443111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:51.444617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:51.491441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 193/373] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:51.492729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:51.496603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:51.578907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 181/374] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 12:46:51.601118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:51.603239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:51.610754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc596b65-dd9e-45eb-af8c-6706fe013e3b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:51.658201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:51.658862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:51.659141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:51.659413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] PATH_INFO: `/v3/projects/aef2b4eee2a24765906ec0ab593443d9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:51.660740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] RBAC: Authorizing `identity:get_project(project_id=aef2b4eee2a24765906ec0ab593443d9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:51.662390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:51.668147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 194/375] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:51 2022] GET /identity/v3/projects/aef2b4eee2a24765906ec0ab593443d9 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:51.671313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:51.751316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:51.804962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac0e53-8567-4e45-9115-871bda0490bd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:51.830320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22a373-c3ee-4b17-b74e-67bfea712e4a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:51.857499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:51.858520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:51.859054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:51.859662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:51.861455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:51.864241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:51.866955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 182/376] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:51 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:51.873063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:51.916935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:51.917497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:51.917768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:51.918036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] PATH_INFO: `/v3/groups/5ec58df851764e19b49b8eebb02472fc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:51.928775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] RBAC: Authorizing `identity:get_group(group_id=5ec58df851764e19b49b8eebb02472fc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:51.930228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:51.932077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 195/377] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:51 2022] GET /identity/v3/groups/5ec58df851764e19b49b8eebb02472fc => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:51.946355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:52.009153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:52.056072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756e3f7-0a0d-40bc-a11b-293b61bff1ea None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:52.117815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:52.118455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:52.118732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:52.119003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:52.123133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:52.124894 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:52.126466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 183/378] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:51 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:52.142952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:52.145456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578b131-981e-4cd9-9050-c51f9627f383 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:52.194711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ab55f-0a11-4231-aa78-6e97b7bee94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:52.196763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ab55f-0a11-4231-aa78-6e97b7bee94a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:52.197919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ab55f-0a11-4231-aa78-6e97b7bee94a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:52.198208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ab55f-0a11-4231-aa78-6e97b7bee94a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:52.198941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ab55f-0a11-4231-aa78-6e97b7bee94a None admin] RBAC: Adding query filter params (group.id=5ec58df851764e19b49b8eebb02472fc, role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=aef2b4eee2a24765906ec0ab593443d9) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:52.199252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ab55f-0a11-4231-aa78-6e97b7bee94a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:52.200933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ab55f-0a11-4231-aa78-6e97b7bee94a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:52.202866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:52.214279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 196/379] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:46:51 2022] GET /identity/v3/role_assignments?group.id=5ec58df851764e19b49b8eebb02472fc&scope.project.id=aef2b4eee2a24765906ec0ab593443d9&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 260 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:52.304867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d75ed-2242-4de1-a392-4cc1a853fac9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:52.362674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15845fff-9fb5-494f-95a2-4491cb936214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:52.363319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15845fff-9fb5-494f-95a2-4491cb936214 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:52.363603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15845fff-9fb5-494f-95a2-4491cb936214 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:52.363881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15845fff-9fb5-494f-95a2-4491cb936214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:52.364657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15845fff-9fb5-494f-95a2-4491cb936214 None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:52.364968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15845fff-9fb5-494f-95a2-4491cb936214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:52.366427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15845fff-9fb5-494f-95a2-4491cb936214 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:52.377217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 184/380] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:46:52 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:52.814993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81aed-b18e-44d9-a436-f9e011ea9829 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:52.814993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81aed-b18e-44d9-a436-f9e011ea9829 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:52.814993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be81aed-b18e-44d9-a436-f9e011ea9829 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:52.814993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 197/381] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:52.821071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b1966-3764-4a87-a221-216fe3ccdb9d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:52.821649 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b1966-3764-4a87-a221-216fe3ccdb9d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:52.822138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b1966-3764-4a87-a221-216fe3ccdb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:52.830496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:52.849702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-817b1966-3764-4a87-a221-216fe3ccdb9d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:52.851474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-817b1966-3764-4a87-a221-216fe3ccdb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:52.961726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 185/382] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:53.290317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81aed-b18e-44d9-a436-f9e011ea9829 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:53.441180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be81aed-b18e-44d9-a436-f9e011ea9829 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:53.496934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c3cba-6cb9-4de8-b01c-a9f34a4ad785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:53.498044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3cba-6cb9-4de8-b01c-a9f34a4ad785 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:53.498590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3cba-6cb9-4de8-b01c-a9f34a4ad785 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:53.499106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c3cba-6cb9-4de8-b01c-a9f34a4ad785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:53.519784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c3cba-6cb9-4de8-b01c-a9f34a4ad785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f19c3cba-6cb9-4de8-b01c-a9f34a4ad785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:53.526257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:53.528292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:53.529868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:53.534636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 198/383] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:53.544461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b1966-3764-4a87-a221-216fe3ccdb9d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:53.581861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c1ca-65aa-45b8-81d6-fd250c0a776d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:53.582613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c1ca-65aa-45b8-81d6-fd250c0a776d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:53.583106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1c1ca-65aa-45b8-81d6-fd250c0a776d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:53.585034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 199/384] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:53.593854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1f95d-d774-4a43-a220-3902402122ff None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:53.594508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1f95d-d774-4a43-a220-3902402122ff None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:53.594988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1f95d-d774-4a43-a220-3902402122ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:53.628376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a6a1f95d-d774-4a43-a220-3902402122ff None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:53.630034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a6a1f95d-d774-4a43-a220-3902402122ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:53.700680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:53.711410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b1966-3764-4a87-a221-216fe3ccdb9d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:53.718443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 200/385] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:53.719952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e2be-f076-41f7-8e99-fd942e8dafce None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:53.720441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e2be-f076-41f7-8e99-fd942e8dafce None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:53.720855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75e2be-f076-41f7-8e99-fd942e8dafce None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:53.722390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 201/386] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:53.731490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debb77-ef0b-4565-a06e-f5a14e79c7e3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:53.731490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debb77-ef0b-4565-a06e-f5a14e79c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:53.731490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4debb77-ef0b-4565-a06e-f5a14e79c7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:53.753572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:53.759148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:53.760196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:53.760721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:53.761208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:53.762124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:53.762634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:53.764263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:53.773064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b4debb77-ef0b-4565-a06e-f5a14e79c7e3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:53.774537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b4debb77-ef0b-4565-a06e-f5a14e79c7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:53.780969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 186/387] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:53.788828 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:53.928545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 202/388] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:53.961184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b04e-c7ee-4ee7-9388-8b7a02241c37 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.012934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.013953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.014429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.014919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.019329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:54.021407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:54.024346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 187/389] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:53 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:54.030365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4debb77-ef0b-4565-a06e-f5a14e79c7e3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.158191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4debb77-ef0b-4565-a06e-f5a14e79c7e3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.187185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:54.212706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.213891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.214371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.214865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.216228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:54.217858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:54.219680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 203/390] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:54.222615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.227485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.307441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:54.352196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae7281-9b9d-4a15-84db-a6a16f4984b1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.378228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef1eaa-4c61-475b-b762-ec4f0ce9b477 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.388177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.388903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.389290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.389638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.402881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:54.409677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:54.410620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:54.411467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:54.419652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 188/391] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:54.420968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.426978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.427773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.428162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.428549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/groups/ac7dee8c073548aab508c227d2ba3c34/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.430554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] RBAC: Authorizing `identity:create_grant(project_id=93f9f5af9f6441b2a336e4b7e0eee419, group_id=ac7dee8c073548aab508c227d2ba3c34, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:54.432266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:54.447529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 204/392] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Sep 14 12:46:54 2022] PUT /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/groups/ac7dee8c073548aab508c227d2ba3c34/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:54.453162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.543834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:54.551001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a817-4a08-4ba3-9064-8bd20a0e0032 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.604263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:54.608510 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63fbb-55ab-4415-9396-a0c888433795 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.631027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.633659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.633951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.634230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.649278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.650063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.650447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.650847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.651619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:54.652293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:54.653773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:54.662023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:54.663860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 205/393] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:54.672851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:54.673874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:54.675417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:54.676908 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.677059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 189/394] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:54.679693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.795597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acda62-5938-478e-973d-19aa55e97331 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.834914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.835544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.835827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.836131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.836807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:54.837110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:54.838773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:54.845184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd69ead-2070-4090-b0b9-f994655b49d3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:54.847643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 190/395] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:54.854407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.880448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:54.889469 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:54.890774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:54.891485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:54.892168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:54.893822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:54.895785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:54.898048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 206/396] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:54.911757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:54.913949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:54.979589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8c59d-995c-42a3-8506-7118a1d21937 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:55.017433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:55.018529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.019010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.019481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.020874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:55.022533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:55.025043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 191/397] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:55.031048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:55.098398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f6908-39eb-42db-8b04-a6ad53c3d439 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:55.136753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836e922-1bd1-43b2-b2bd-92ca3af2a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:55.137665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e922-1bd1-43b2-b2bd-92ca3af2a987 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.138104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e922-1bd1-43b2-b2bd-92ca3af2a987 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.138525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e922-1bd1-43b2-b2bd-92ca3af2a987 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.139823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e922-1bd1-43b2-b2bd-92ca3af2a987 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:55.140235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd8bc-fed3-4878-9725-1fb390dcae34 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:55.141734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836e922-1bd1-43b2-b2bd-92ca3af2a987 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:55.143909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 207/398] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:54 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:55.145331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65498b8e-7742-49a9-8d48-61e854418b2f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.145769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65498b8e-7742-49a9-8d48-61e854418b2f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.146174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65498b8e-7742-49a9-8d48-61e854418b2f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.147848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 208/399] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:55.153632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65498b8e-7742-49a9-8d48-61e854418b2f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:55.161397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:55.192352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e87f74-525f-41d0-8077-5ca8698e19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:55.194060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87f74-525f-41d0-8077-5ca8698e19bd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.194738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87f74-525f-41d0-8077-5ca8698e19bd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.195283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e87f74-525f-41d0-8077-5ca8698e19bd None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.196781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87f74-525f-41d0-8077-5ca8698e19bd None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:55.198932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e87f74-525f-41d0-8077-5ca8698e19bd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:55.201478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 192/400] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:55 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:55.206252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f793899-0b02-4df4-9540-80e4971a0b91 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.206521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f793899-0b02-4df4-9540-80e4971a0b91 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.206800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f793899-0b02-4df4-9540-80e4971a0b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.217482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:55.228284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2f793899-0b02-4df4-9540-80e4971a0b91 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:55.230028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2f793899-0b02-4df4-9540-80e4971a0b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:55.299838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65498b8e-7742-49a9-8d48-61e854418b2f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:55.313831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 193/401] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:55.314687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f793899-0b02-4df4-9540-80e4971a0b91 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:55.347386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41833967-51d9-465d-8da7-5a5b015635dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:55.348686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833967-51d9-465d-8da7-5a5b015635dc None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.349616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833967-51d9-465d-8da7-5a5b015635dc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.349896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41833967-51d9-465d-8da7-5a5b015635dc None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/groups/ac7dee8c073548aab508c227d2ba3c34/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.354457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41833967-51d9-465d-8da7-5a5b015635dc None admin] RBAC: Authorizing `identity:create_grant(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68, group_id=ac7dee8c073548aab508c227d2ba3c34, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:55.355914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41833967-51d9-465d-8da7-5a5b015635dc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:55.388617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 209/402] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Sep 14 12:46:55 2022] PUT /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/groups/ac7dee8c073548aab508c227d2ba3c34/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:55.420308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef46ca-08d1-42a6-9c8a-b02a52979ed9 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.420739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef46ca-08d1-42a6-9c8a-b02a52979ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.421254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef46ca-08d1-42a6-9c8a-b02a52979ed9 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.423383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 210/403] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:46:55.429054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be920c-922f-4100-abb8-246ea0eb581c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.429368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be920c-922f-4100-abb8-246ea0eb581c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.429625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be920c-922f-4100-abb8-246ea0eb581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.469230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-43be920c-922f-4100-abb8-246ea0eb581c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:55.470446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43be920c-922f-4100-abb8-246ea0eb581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:55.481366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f793899-0b02-4df4-9540-80e4971a0b91 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:55.502629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:55.570114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 211/404] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:55.587213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:55.587910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.588236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.588551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/groups/ac7dee8c073548aab508c227d2ba3c34/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.595324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] RBAC: Authorizing `identity:create_grant(project_id=93f9f5af9f6441b2a336e4b7e0eee419, group_id=ac7dee8c073548aab508c227d2ba3c34, role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:55.596829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:55.626612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 194/405] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Sep 14 12:46:55 2022] PUT /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419/groups/ac7dee8c073548aab508c227d2ba3c34/roles/e02cd49dfc6343ce87700207db79ff78 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:46:55.685996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be920c-922f-4100-abb8-246ea0eb581c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:55.745302 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:55.879964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be920c-922f-4100-abb8-246ea0eb581c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:55.937956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:55.941595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:55.943374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:55.943649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:55.943930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:55.961788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:55.967331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:55.968365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:46:55.969182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:55.971934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 212/406] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:55.980052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.125462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f60ee-a0de-4b61-a158-7752a6aa15bd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.167348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:56.167962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:56.168511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:56.168782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:56.170805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:56.184374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c76ec6-a9e0-4b8f-a4f5-4b36c376bdfd None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.191710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:56.196798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:56.199098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:56.202296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 195/407] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:56.211832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.263822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:56.264469 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:56.264754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:56.265030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:56.265701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:56.265998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:56.267404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:56.276170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:56.297492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 213/408] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:56.303406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.363325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9b4d7-d01e-470d-8c33-30363656d52a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.426290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:56.427049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:56.427323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:56.427587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:56.428276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:56.428577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:56.429939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:56.446030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 196/409] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:56.455718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.553740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37167-13b6-429f-87c3-89fb0259a818 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.592470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:56.596405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a233ab4-f5f6-4c46-83d5-7b5e58dfa444 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.629362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:56.630031 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:56.632920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:56.632920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] PATH_INFO: `/v3/groups/5ec58df851764e19b49b8eebb02472fc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:56.632920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] RBAC: Authorizing `identity:get_group(group_id=5ec58df851764e19b49b8eebb02472fc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:56.633312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:56.635050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 214/410] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:56 2022] GET /identity/v3/groups/5ec58df851764e19b49b8eebb02472fc => generated 229 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:46:56.642815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.643073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:56.643690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:56.643971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:56.644360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:56.645742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:56.647200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:56.653893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 197/411] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:56 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:56.655288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.702234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:56.790426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf2ced-473a-4021-a2a6-04c314ade943 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.823996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830ea2-98cd-493b-be3b-05ed43da9a08 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.829662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:56.830319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:56.830598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:56.830869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] PATH_INFO: `/v3/projects/aef2b4eee2a24765906ec0ab593443d9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:56.832060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] RBAC: Authorizing `identity:get_project(project_id=aef2b4eee2a24765906ec0ab593443d9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:56.839963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:56.844276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 215/412] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:56 2022] GET /identity/v3/projects/aef2b4eee2a24765906ec0ab593443d9 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:56.849203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.904830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:56.905499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:56.905779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:56.906053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:56.907364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:56.908899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:56.910884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 198/413] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:56 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:56.917554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:56.972846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:56.975341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfdf8e-3fb3-41b2-af29-bcb4eece0764 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:56.996415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:57.012921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9f3a0-ec49-4fe8-9754-5342f1306887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:57.013596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9f3a0-ec49-4fe8-9754-5342f1306887 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:57.013876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9f3a0-ec49-4fe8-9754-5342f1306887 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:57.014151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9f3a0-ec49-4fe8-9754-5342f1306887 None admin] PATH_INFO: `/v3/projects/aef2b4eee2a24765906ec0ab593443d9/groups/5ec58df851764e19b49b8eebb02472fc/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:57.016120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9f3a0-ec49-4fe8-9754-5342f1306887 None admin] RBAC: Authorizing `identity:create_grant(project_id=aef2b4eee2a24765906ec0ab593443d9, group_id=5ec58df851764e19b49b8eebb02472fc, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:57.017561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9f3a0-ec49-4fe8-9754-5342f1306887 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:57.042203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 216/414] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Sep 14 12:46:56 2022] PUT /identity/v3/projects/aef2b4eee2a24765906ec0ab593443d9/groups/5ec58df851764e19b49b8eebb02472fc/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:46:57.106653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1be35-2a82-478b-975a-0df9ed1c070e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:57.189364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41094f-1970-4012-846c-bf0ddc42f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:57.190148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41094f-1970-4012-846c-bf0ddc42f8b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:57.190425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41094f-1970-4012-846c-bf0ddc42f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:57.190730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41094f-1970-4012-846c-bf0ddc42f8b9 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/groups/ac7dee8c073548aab508c227d2ba3c34/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:57.193479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41094f-1970-4012-846c-bf0ddc42f8b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68, group_id=ac7dee8c073548aab508c227d2ba3c34, role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:57.195334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41094f-1970-4012-846c-bf0ddc42f8b9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:57.222939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 199/415] 10.222.0.50 () {58 vars in 1442 bytes} [Wed Sep 14 12:46:56 2022] PUT /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68/groups/ac7dee8c073548aab508c227d2ba3c34/roles/e02cd49dfc6343ce87700207db79ff78 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:46:57.550328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60922cd-42f3-4dc5-806e-3612d81de37e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:57.550668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60922cd-42f3-4dc5-806e-3612d81de37e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:57.550872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60922cd-42f3-4dc5-806e-3612d81de37e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:57.552618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 217/416] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:57.561892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95382d-5933-4e4e-89e2-f96b13654d94 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:57.562384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95382d-5933-4e4e-89e2-f96b13654d94 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:57.562863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95382d-5933-4e4e-89e2-f96b13654d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:57.593108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4f95382d-5933-4e4e-89e2-f96b13654d94 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:57.595097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4f95382d-5933-4e4e-89e2-f96b13654d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:57.743676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 200/417] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:58.160703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60922cd-42f3-4dc5-806e-3612d81de37e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:58.253916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951c0e-5f1a-4aa2-9451-e492f8eb095b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:58.254469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951c0e-5f1a-4aa2-9451-e492f8eb095b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:58.254885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf951c0e-5f1a-4aa2-9451-e492f8eb095b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:58.256688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 201/418] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:46:58.262669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c593b-691c-467e-981e-1d6fc2258b31 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:58.263170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c593b-691c-467e-981e-1d6fc2258b31 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:58.263617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c593b-691c-467e-981e-1d6fc2258b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:58.284050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-883c593b-691c-467e-981e-1d6fc2258b31 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:58.285610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-883c593b-691c-467e-981e-1d6fc2258b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:58.303143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:58.411884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60922cd-42f3-4dc5-806e-3612d81de37e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:58.427043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 202/419] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:46:58.470990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d710929-27e3-4cd2-830f-23deca778ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:58.472038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710929-27e3-4cd2-830f-23deca778ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:58.472515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710929-27e3-4cd2-830f-23deca778ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:58.473027 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710929-27e3-4cd2-830f-23deca778ad5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:58.489560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d710929-27e3-4cd2-830f-23deca778ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8d710929-27e3-4cd2-830f-23deca778ad5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:58.496036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:58.496931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:58.497722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:58.505161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 218/420] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:58.511279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c593b-691c-467e-981e-1d6fc2258b31 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:58.555184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8482-882f-41dc-85ba-be57eb2b9fc5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:58.555808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8482-882f-41dc-85ba-be57eb2b9fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:58.556333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8482-882f-41dc-85ba-be57eb2b9fc5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:58.559565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 219/421] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:46:58.578788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b154-39f9-4ae5-83e7-580104061471 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:58.579110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b154-39f9-4ae5-83e7-580104061471 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:58.579332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6697b154-39f9-4ae5-83e7-580104061471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:58.617752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6697b154-39f9-4ae5-83e7-580104061471 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:46:58.618966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6697b154-39f9-4ae5-83e7-580104061471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:46:58.637770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:58.685392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c593b-691c-467e-981e-1d6fc2258b31 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:58.733857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:58.735470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:58.736456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:58.738225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:58.739119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:58.740386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:58.741942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:58.760160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 203/422] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:58.768027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:58.792824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 220/423] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:46:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:46:58.794532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:58.835075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697b154-39f9-4ae5-83e7-580104061471 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:58.908911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c6fc-1bbd-4bde-baa9-5a62dd837d81 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:58.953981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:58.954621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:58.954850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:58.955123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.017352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6697b154-39f9-4ae5-83e7-580104061471 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:59.074237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:59.074883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:59.075822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:59.076126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.084737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:59.088682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:59.103283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:59.109431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:59.110358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:46:59.111176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:46:59.117097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 221/424] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:46:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:46:59.120580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.121525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.128582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.246693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab207e5c-fc9a-445f-a61a-f9153f612ba0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:59.248423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 204/425] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:59.249270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.287888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:59.288533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:59.288798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:59.289067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.289731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:59.290030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:59.291951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:59.303484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 222/426] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:59.304713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.376963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.381543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ab89d-3b34-401d-b2cf-d19d70843fc3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:59.399236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.434299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7d236-5f55-4a21-a319-62d91acdd9c1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:59.453593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:59.455950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:59.456741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:59.457458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.477880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:59.480282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:59.480783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:59.481233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.483383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:59.486011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:46:59.486704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:59.490455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 223/427] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:59.492172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:46:59.492589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:46:59.493467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 14 12:46:59.494973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:46:59.502382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 205/428] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:46:59.502382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.620931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d356a9-3e42-4b2e-bdbe-d2c4b0861150 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:59.623604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f64b62-fdbc-4c91-b33f-24745c671b34 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:59.660815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.664255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:59.665027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:59.665410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:59.665708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.667875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:59.670028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a678-d732-425d-84fe-59b229614844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:59.670404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:59.671052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a678-d732-425d-84fe-59b229614844 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:59.671575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a678-d732-425d-84fe-59b229614844 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:59.672051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526a678-d732-425d-84fe-59b229614844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.672702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 206/429] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:59.673656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.718486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.757203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a678-d732-425d-84fe-59b229614844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:59.759104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526a678-d732-425d-84fe-59b229614844 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:59.788217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac6f0f-acd6-4dad-8946-fafaf89ed145 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:46:59.831095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:46:59.831848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:46:59.832225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:46:59.832674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:46:59.833314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] RBAC: Adding query filter params (name=member) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:46:59.833684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:46:59.835237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:46:59.845272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 207/430] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:46:59.846688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.895860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 224/431] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:46:59.897046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a678-d732-425d-84fe-59b229614844 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:46:59.933346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.968957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:46:59.973908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1b7c3-8812-4ae2-9f47-96c74f12876d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:00.022684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:00.023214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.023501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.023778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.024548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:00.026031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:00.026150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526a678-d732-425d-84fe-59b229614844 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:00.027493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:00.034303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 208/432] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:00.038093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:00.073062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19df884-a2d6-4256-b0c7-cd1637b3657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:00.074008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19df884-a2d6-4256-b0c7-cd1637b3657f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.074388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19df884-a2d6-4256-b0c7-cd1637b3657f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.074788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19df884-a2d6-4256-b0c7-cd1637b3657f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.160851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19df884-a2d6-4256-b0c7-cd1637b3657f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:00.162706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19df884-a2d6-4256-b0c7-cd1637b3657f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:00.187461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69604da4-cee7-44eb-8812-9e3575af0fda None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:00.200595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:00.231151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bff514-7cf9-4cd3-8684-aa0d8b149600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:00.232106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bff514-7cf9-4cd3-8684-aa0d8b149600 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.232546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bff514-7cf9-4cd3-8684-aa0d8b149600 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.232961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bff514-7cf9-4cd3-8684-aa0d8b149600 None admin] PATH_INFO: `/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.234490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bff514-7cf9-4cd3-8684-aa0d8b149600 None admin] RBAC: Authorizing `identity:get_project(project_id=93f9f5af9f6441b2a336e4b7e0eee419)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:00.235896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bff514-7cf9-4cd3-8684-aa0d8b149600 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:00.237551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 209/433] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:47:00 2022] GET /identity/v3/projects/93f9f5af9f6441b2a336e4b7e0eee419 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:00.238983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ed4bc-a1f1-4d09-829b-1b11ad361280 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.239261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ed4bc-a1f1-4d09-829b-1b11ad361280 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.239530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ed4bc-a1f1-4d09-829b-1b11ad361280 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.240942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 210/434] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:00.241923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bbe9e-bfa3-4269-8c74-ff17f302b548 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.242569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bbe9e-bfa3-4269-8c74-ff17f302b548 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.242844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bbe9e-bfa3-4269-8c74-ff17f302b548 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.244774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 211/435] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:00.245842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bbe9e-bfa3-4269-8c74-ff17f302b548 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:00.287078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:00.301732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 225/436] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:46:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:00.303983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0bf9f-cd4a-4ac0-b82f-72b543384b48 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.304504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0bf9f-cd4a-4ac0-b82f-72b543384b48 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.305019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0bf9f-cd4a-4ac0-b82f-72b543384b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.328473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-01f0bf9f-cd4a-4ac0-b82f-72b543384b48 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:00.329691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-01f0bf9f-cd4a-4ac0-b82f-72b543384b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:00.374510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bbe9e-bfa3-4269-8c74-ff17f302b548 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:00.426485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 226/437] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:00.426485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ef3e-990e-41f2-b1d4-04aad77ed1be None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.427018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ef3e-990e-41f2-b1d4-04aad77ed1be None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.427480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ef3e-990e-41f2-b1d4-04aad77ed1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.430921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:00.431579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.431879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.432149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.433392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:00.434820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:00.436879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 212/438] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:47:00 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:00.437170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:00.460647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5646ef3e-990e-41f2-b1d4-04aad77ed1be None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:00.462432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5646ef3e-990e-41f2-b1d4-04aad77ed1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:00.549474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:00.564591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 227/439] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:00.576855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646ef3e-990e-41f2-b1d4-04aad77ed1be None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:00.576981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a234b1-768d-4b9e-bfcc-d23722818f40 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:00.577621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:00.638250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:00.639546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.640056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.641171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.644987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:00.647162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:00.656195 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 213/440] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:47:00 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:00.657570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:00.759711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646ef3e-990e-41f2-b1d4-04aad77ed1be None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:00.805963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:00.806477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.807307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.807582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.808344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:00.808649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:00.810206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:00.828052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 228/441] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:47:00 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=93f9f5af9f6441b2a336e4b7e0eee419&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 611 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:00.828052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:00.835020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618febca-7099-4e31-bb50-dea0776ca977 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:00.877423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:00.878224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:00.878501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:00.879166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:00.880227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:00.881937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:00.883995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 214/442] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:47:00 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:00.885824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:00.901182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:00.930009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:00.965295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3363e3-5e41-45b3-bbd1-2b073a0f5e95 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.019379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64f66-c212-4cd6-8a7f-0c91ba4569b7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.020040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.020712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.020995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.021267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.036281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:01.041627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:01.043071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:01.043893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 229/443] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:01.045242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.066675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.067241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.067520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.067793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.081879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:01.088083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:01.089747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 215/444] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:01.090580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.176097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83db00-5f2a-44e9-8120-ac1d5decd980 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.201781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:01.215167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.215779 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.216545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.216659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:01.216750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.217086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=f325e8ec498a48e3a4eb22e6e65148f9, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:01.217476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:01.219195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:01.223736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1bf72-ff9e-4869-a347-445cefa8a117 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.225581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 230/445] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=f325e8ec498a48e3a4eb22e6e65148f9 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:01.226545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.275315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.276663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.277356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.277776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.278693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:01.279158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:01.280822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:01.292131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 216/446] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:01.298409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.386107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e32f50-dc98-4e9e-a709-443d7808d2c2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.430475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19cce5-1df1-4ee4-9710-b489042e925d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.433612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.434464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.434741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.435040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.435722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:01.436058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:01.437472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:01.446657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 231/447] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:01.453295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.476454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.477077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.477358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.477636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.505195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:01.512826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:01.563472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:01.566290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:01.579560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8de8b-2303-42df-97e7-6f79864a83fa None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.631170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.631796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.632504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.632504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.680875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 217/448] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 12:47:01.686923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.707996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:01.710304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:01.745931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:01.752095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:01.787500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf819b-4c1b-4c21-9457-a426639bc31b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.813988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 232/449] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 14 12:47:01.819792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.826343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.827021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.827416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.827791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] PATH_INFO: `/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.828800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] RBAC: Authorizing `identity:get_project(project_id=c71bb6721cdd48ef9b0e7c3e0e262e68)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:01.830254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:01.831888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 218/450] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/projects/c71bb6721cdd48ef9b0e7c3e0e262e68 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:01.837877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:01.935824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68143a93-e38a-4393-a8c1-dc46c50b10b1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.973765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b471-a417-4961-b98d-4388f0ea63cf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:01.976755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:01.977392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:01.977670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:01.977941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] PATH_INFO: `/v3/projects/aef2b4eee2a24765906ec0ab593443d9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:01.979148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] RBAC: Authorizing `identity:get_project(project_id=aef2b4eee2a24765906ec0ab593443d9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:01.980667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:01.982311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 233/451] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/projects/aef2b4eee2a24765906ec0ab593443d9 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:01.987817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:02.000183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:02.001455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:02.011651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:02.012299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:02.012588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:02.012868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] PATH_INFO: `/v3/groups/ac7dee8c073548aab508c227d2ba3c34` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:02.013980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] RBAC: Authorizing `identity:get_group(group_id=ac7dee8c073548aab508c227d2ba3c34)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:02.015449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:02.017029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 219/452] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/groups/ac7dee8c073548aab508c227d2ba3c34 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:02.022960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:02.096226 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ce669-f6ba-4a66-962f-95b3ccc304d0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:02.130498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6260a2-dee1-4ffe-b798-ebc23dafe36a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:02.133663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:02.134300 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:02.134581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:02.135396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] PATH_INFO: `/v3/groups/5ec58df851764e19b49b8eebb02472fc` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:02.136570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] RBAC: Authorizing `identity:get_group(group_id=5ec58df851764e19b49b8eebb02472fc)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:02.138026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:02.139606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 234/453] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Sep 14 12:47:01 2022] GET /identity/v3/groups/5ec58df851764e19b49b8eebb02472fc => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:02.145438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:02.166851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52014aa0-413b-4acb-ad57-d270e1e17699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:02.167491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52014aa0-413b-4acb-ad57-d270e1e17699 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:02.167771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52014aa0-413b-4acb-ad57-d270e1e17699 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:02.168077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52014aa0-413b-4acb-ad57-d270e1e17699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:02.168820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52014aa0-413b-4acb-ad57-d270e1e17699 None admin] RBAC: Adding query filter params (group.id=ac7dee8c073548aab508c227d2ba3c34, role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:02.169130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52014aa0-413b-4acb-ad57-d270e1e17699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:02.170595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52014aa0-413b-4acb-ad57-d270e1e17699 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:02.176779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 220/454] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:47:02 2022] GET /identity/v3/role_assignments?group.id=ac7dee8c073548aab508c227d2ba3c34&scope.project.id=c71bb6721cdd48ef9b0e7c3e0e262e68&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:02.233563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:02.258322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c69d7-219c-4715-91e6-20180af1ee42 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:02.296399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc4955-dbd6-426f-a29f-2c5d13d0b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:02.297013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc4955-dbd6-426f-a29f-2c5d13d0b88d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:02.297287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc4955-dbd6-426f-a29f-2c5d13d0b88d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:02.297631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc4955-dbd6-426f-a29f-2c5d13d0b88d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:02.298289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc4955-dbd6-426f-a29f-2c5d13d0b88d None admin] RBAC: Adding query filter params (group.id=5ec58df851764e19b49b8eebb02472fc, role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=aef2b4eee2a24765906ec0ab593443d9) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:02.298592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc4955-dbd6-426f-a29f-2c5d13d0b88d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:02.300049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc4955-dbd6-426f-a29f-2c5d13d0b88d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:02.307248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 235/455] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Sep 14 12:47:02 2022] GET /identity/v3/role_assignments?group.id=5ec58df851764e19b49b8eebb02472fc&scope.project.id=aef2b4eee2a24765906ec0ab593443d9&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:05.111663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b3825-25ae-4358-819c-81bc16780bd9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:05.112626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b3825-25ae-4358-819c-81bc16780bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:05.113051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b3825-25ae-4358-819c-81bc16780bd9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:05.114876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 221/456] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:05.120484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d69d-134f-4980-8312-dc4d9a5b7410 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:05.121001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d69d-134f-4980-8312-dc4d9a5b7410 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:05.121211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52d69d-134f-4980-8312-dc4d9a5b7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:05.146191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ea52d69d-134f-4980-8312-dc4d9a5b7410 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:05.147474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ea52d69d-134f-4980-8312-dc4d9a5b7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:05.270795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 236/457] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:05.294393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88453-4ccf-460e-b082-630dda5945f6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:05.294739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88453-4ccf-460e-b082-630dda5945f6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:05.294936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e88453-4ccf-460e-b082-630dda5945f6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:05.296686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 222/458] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:05.302273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754eef-533f-4a09-8511-27346bfff2ca None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:05.302576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754eef-533f-4a09-8511-27346bfff2ca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:05.302846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e754eef-533f-4a09-8511-27346bfff2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:05.329546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8e754eef-533f-4a09-8511-27346bfff2ca None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:05.331216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8e754eef-533f-4a09-8511-27346bfff2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:05.430850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 237/459] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:05.651072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88453-4ccf-460e-b082-630dda5945f6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:05.740499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:05.766768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbfa90-74a4-48cf-a9a1-a2f4c76a3694 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:05.767114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbfa90-74a4-48cf-a9a1-a2f4c76a3694 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:05.767392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbfa90-74a4-48cf-a9a1-a2f4c76a3694 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:05.769158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 238/460] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:05.781870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a203-3621-4b54-8f5b-cc9656813ec6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:05.782183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a203-3621-4b54-8f5b-cc9656813ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:05.782425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880a203-3621-4b54-8f5b-cc9656813ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:05.824435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:05.826098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e88453-4ccf-460e-b082-630dda5945f6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:05.840387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a880a203-3621-4b54-8f5b-cc9656813ec6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:05.841711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a880a203-3621-4b54-8f5b-cc9656813ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:05.927989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:05.929140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:05.929626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:05.930093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:05.955278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:05.961604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:06.009143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:06.013180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:06.014845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:06.014845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:06.014845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:06.015147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 239/461] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:06.015147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a203-3621-4b54-8f5b-cc9656813ec6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:06.020268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 223/462] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:06.027444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:06.276528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880a203-3621-4b54-8f5b-cc9656813ec6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:06.322993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd4716-1c0d-4166-80c1-2104e97ade1f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:06.324546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:06.344900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:06.345584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.345869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.346153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.346675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:06.376495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:06.376495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:06.400079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:06.401027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.401392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.401670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.403017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:06.403328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:06.405260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:06.414563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:06.415546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:06.417315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:06.417315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:06.417315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:06.420178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 240/463] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:06.429103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:06.442491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 224/464] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:06.451884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:06.609738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8498d-1b4c-4d5e-b148-6da9f36857cc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:06.643644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa36ca6-7671-472f-90ea-5a15de805bb4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:06.680598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:06.681232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.682331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.682885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.683279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:06.683588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:06.685265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:06.694552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a899ed8-b908-4793-aebe-026984dad37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:06.695331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a899ed8-b908-4793-aebe-026984dad37a None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.695611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a899ed8-b908-4793-aebe-026984dad37a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.695880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a899ed8-b908-4793-aebe-026984dad37a None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.696721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a899ed8-b908-4793-aebe-026984dad37a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:06.699024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a899ed8-b908-4793-aebe-026984dad37a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:06.706316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 241/465] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:06.707409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:06.731251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 225/466] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:47:06 2022] POST /identity/v3/users => generated 246 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:47:06.733241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8fb20-b35c-43fa-b476-6c8cbc2eb1e2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.733881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8fb20-b35c-43fa-b476-6c8cbc2eb1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.734232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8fb20-b35c-43fa-b476-6c8cbc2eb1e2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.740419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 226/467] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:06.742979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8fb20-b35c-43fa-b476-6c8cbc2eb1e2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:06.782038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:06.794647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:06.863089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67621c9a-187d-42f8-9311-b03082c5c323 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:06.894582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8fb20-b35c-43fa-b476-6c8cbc2eb1e2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:06.918770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e52e-b638-4825-a2d7-05a4685fdf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:06.919601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e52e-b638-4825-a2d7-05a4685fdf06 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.919979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e52e-b638-4825-a2d7-05a4685fdf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.920577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e52e-b638-4825-a2d7-05a4685fdf06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.936444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e52e-b638-4825-a2d7-05a4685fdf06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:06.938152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e52e-b638-4825-a2d7-05a4685fdf06 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:06.943547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a2aed-f783-4aef-8a87-8451ebfd97c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:06.944284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2aed-f783-4aef-8a87-8451ebfd97c6 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.944568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2aed-f783-4aef-8a87-8451ebfd97c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.944839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2aed-f783-4aef-8a87-8451ebfd97c6 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.945565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a2aed-f783-4aef-8a87-8451ebfd97c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:06.947323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a2aed-f783-4aef-8a87-8451ebfd97c6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2c03e52e-b638-4825-a2d7-05a4685fdf06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:06.957893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:06.958844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:06.960554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:06.960554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:06.960554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:06.960554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 242/468] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:06.960554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cdce8-0d8a-4e2c-8158-cf53b875a2bf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.961113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cdce8-0d8a-4e2c-8158-cf53b875a2bf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.961113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cdce8-0d8a-4e2c-8158-cf53b875a2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.975588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 227/469] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:47:06 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:06.976968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73a98-204e-463b-b8ed-59dfe53a9414 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:06.977280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73a98-204e-463b-b8ed-59dfe53a9414 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:06.977521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73a98-204e-463b-b8ed-59dfe53a9414 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:06.981586 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 228/470] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:06.981586 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b73a98-204e-463b-b8ed-59dfe53a9414 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:06.983341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-372cdce8-0d8a-4e2c-8158-cf53b875a2bf None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:06.984136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-372cdce8-0d8a-4e2c-8158-cf53b875a2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:07.096719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 243/471] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:07.098838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c0d1-d642-4ac1-a541-ddab0c9e8a3a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:07.099447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c0d1-d642-4ac1-a541-ddab0c9e8a3a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:07.099734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71c0d1-d642-4ac1-a541-ddab0c9e8a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:07.121664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1a71c0d1-d642-4ac1-a541-ddab0c9e8a3a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:07.122897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1a71c0d1-d642-4ac1-a541-ddab0c9e8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:07.127263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:07.165041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:07.170508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b73a98-204e-463b-b8ed-59dfe53a9414 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:07.237025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:07.237699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:07.238142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:07.240078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:07.240936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:07.241321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:07.243004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:07.256449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 244/472] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:07.262151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 229/473] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:07.267598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c0d1-d642-4ac1-a541-ddab0c9e8a3a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:07.420584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71c0d1-d642-4ac1-a541-ddab0c9e8a3a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:07.463227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:07.463912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:07.464271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:07.464552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:07.465598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:07.466997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:07.467447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:07.494857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 245/474] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:47:07 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:07.566326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:07.607075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:07.683315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c03f81-81dd-4281-a6e3-7094f40e9d01 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:07.741862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:07.742938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:07.743410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:07.744385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:07.756464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614a6ce-153b-4595-9c07-c14680594a28 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:07.765318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:07.767788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:07.770736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:07.790028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:07.792352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:07.793517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:07.793517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:07.793517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:07.793517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 230/475] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:07.800050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:07.812536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:07.813351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:07.813789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:07.814167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:07.814990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:07.816795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:07.826896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.sql.core [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 12:47:07.826896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 12:47:07.826896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [parameters: {'id': '6e4b0912d79d46748d3e38467b56daa3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 12:47:07.826896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Sep 14 12:47:07.847695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return ref.to_dict() Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 12:47:07.849370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application yield resource Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application next(self.gen) Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise self.value Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application session.commit() Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 12:47:07.850726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.session.flush() Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application compat.raise_( Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 12:47:07.851584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 12:47:07.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application conn.query(q) Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application result.read() Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 12:47:07.854543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [parameters: {'id': '6e4b0912d79d46748d3e38467b56daa3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:07.856612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 14 12:47:07.860094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:07.862262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 246/476] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Sep 14 12:47:07 2022] POST /identity/v3/roles => generated 144 bytes in 284 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:07.862262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:07.976498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:07.981963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fec33-241b-47a8-9c0b-0790bd8d24de None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:08.017242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa10ed-2e15-4c3f-8c88-2715500a1c3f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:08.084300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:08.085296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:08.085772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:08.086249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:08.087407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:08.088545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:08.093618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:08.109385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 231/477] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:08.114946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:08.134013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:08.135342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:08.135761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:08.136049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:08.165158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:08.170744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:08.171813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 14 12:47:08.172968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:08.175854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 247/478] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:08.184153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:08.240132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:08.356675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee81660-0604-4ed5-b912-ce1f2835aa37 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:08.371215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36eacd-27d7-47ad-9f18-5e9aa0aa609e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:08.432066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e96d0-62e4-40fd-bd71-54d0d68d7278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:08.432688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e96d0-62e4-40fd-bd71-54d0d68d7278 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:08.432963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e96d0-62e4-40fd-bd71-54d0d68d7278 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:08.433234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e96d0-62e4-40fd-bd71-54d0d68d7278 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:08.433890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e96d0-62e4-40fd-bd71-54d0d68d7278 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:08.435324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e96d0-62e4-40fd-bd71-54d0d68d7278 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:08.441859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0481-8b2f-4481-a89c-216b27e2ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:08.442473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0481-8b2f-4481-a89c-216b27e2ff66 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:08.442750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0481-8b2f-4481-a89c-216b27e2ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:08.443020 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0481-8b2f-4481-a89c-216b27e2ff66 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:08.443689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0481-8b2f-4481-a89c-216b27e2ff66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:08.443989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0481-8b2f-4481-a89c-216b27e2ff66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:08.445396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0481-8b2f-4481-a89c-216b27e2ff66 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:08.453378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:08.465321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 248/479] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:08.497348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 232/480] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:47:08 2022] POST /identity/v3/users => generated 249 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:09.553171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f39a3-6bf1-4b8b-a01a-2af5b787f887 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:09.553701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f39a3-6bf1-4b8b-a01a-2af5b787f887 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:09.553701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f39a3-6bf1-4b8b-a01a-2af5b787f887 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:09.555201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 249/481] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:09.569772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b456874-393c-4ea1-9b62-d0e4c82116b9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:09.570282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b456874-393c-4ea1-9b62-d0e4c82116b9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:09.570356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b456874-393c-4ea1-9b62-d0e4c82116b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:09.601679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7b456874-393c-4ea1-9b62-d0e4c82116b9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:09.602880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7b456874-393c-4ea1-9b62-d0e4c82116b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:09.705344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 233/482] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:10.258282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f39a3-6bf1-4b8b-a01a-2af5b787f887 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:10.300764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3523-db12-4910-82a6-550f5003e94f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:10.301392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3523-db12-4910-82a6-550f5003e94f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:10.301896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a3523-db12-4910-82a6-550f5003e94f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:10.303709 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 234/483] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:10.310503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff80b-5aae-4b1c-8d30-da10074c023b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:10.310784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff80b-5aae-4b1c-8d30-da10074c023b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:10.311062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeff80b-5aae-4b1c-8d30-da10074c023b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:10.349137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6aeff80b-5aae-4b1c-8d30-da10074c023b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:10.350369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6aeff80b-5aae-4b1c-8d30-da10074c023b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:10.375601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f39a3-6bf1-4b8b-a01a-2af5b787f887 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:10.414473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:10.415121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:10.415397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:10.416373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:10.428685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:10.434786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:10.435740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:10.437008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 250/484] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:10.442678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:10.477481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:10.522338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:10.564890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 235/485] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:10.595030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d83e6-9542-4645-a574-0a24a228f8af None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:10.617877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6aa36-066b-450f-aa8b-0c57f845f5a1 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:10.618751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6aa36-066b-450f-aa8b-0c57f845f5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:10.619454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6aa36-066b-450f-aa8b-0c57f845f5a1 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:10.621403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 236/486] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:10.633713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149c75-1d04-4566-aaea-fdbd901a000a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:10.634369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149c75-1d04-4566-aaea-fdbd901a000a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:10.634862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e149c75-1d04-4566-aaea-fdbd901a000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:10.658693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:10.659403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:10.659693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:10.659969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:10.660688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:10.660998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:10.662412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:10.668883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1e149c75-1d04-4566-aaea-fdbd901a000a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:10.670092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1e149c75-1d04-4566-aaea-fdbd901a000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:10.679662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 251/487] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:10.692953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:10.813731 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 237/488] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:47:10.862037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884af74a-7bec-4bbf-8749-badacc8c8d98 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:10.901728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:10.905380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:10.906044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:10.906831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:10.907104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:10.924266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:10.925736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:10.937694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149c75-1d04-4566-aaea-fdbd901a000a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:10.944533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:10.945477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:10.946410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:10.946410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:10.946410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:10.946410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 252/489] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:10.952525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.108285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016be1f9-0b13-4e1d-b333-2c338b387ac1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.146068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.146687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.147081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.147361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.148030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:11.148342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:11.149856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:11.168177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 253/490] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:11.170152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.220444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:11.222800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:11.230108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e149c75-1d04-4566-aaea-fdbd901a000a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.275160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.276472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.276779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.277317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.291428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:11.296720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:11.297900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:11.298930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:11.303044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 238/491] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:11.304183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.316420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80349ce-73ab-4192-afa3-a430db89d057 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.360084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.361021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.361375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.362227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.371416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:11.373868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:11.390817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:11.392956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 254/492] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:47:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:11.395190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.436286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1dac9d-c2cf-4e13-8fa2-f0d9bf22fb75 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.485561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.486204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.486548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.486829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.498348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:11.503187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:11.504530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 239/493] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:11.505873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.523231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:11.534265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b967e5-4e42-4f54-94f6-2b80c5605f06 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.547358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:11.579837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963c6f4-6b4e-4b40-9395-ce96fcc84404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.582492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c6f4-6b4e-4b40-9395-ce96fcc84404 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.582492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c6f4-6b4e-4b40-9395-ce96fcc84404 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.582492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963c6f4-6b4e-4b40-9395-ce96fcc84404 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.583621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c6f4-6b4e-4b40-9395-ce96fcc84404 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:11.584502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c6f4-6b4e-4b40-9395-ce96fcc84404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:11.586697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963c6f4-6b4e-4b40-9395-ce96fcc84404 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:11.600111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 255/494] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:11.601380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914a3b-3e65-4952-836a-14b1b4d3bfb8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.601670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914a3b-3e65-4952-836a-14b1b4d3bfb8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.601950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3914a3b-3e65-4952-836a-14b1b4d3bfb8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.603449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 256/495] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:11.604250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914a3b-3e65-4952-836a-14b1b4d3bfb8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.663964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9772f31-f43b-4a5a-bf78-2a41b27527c8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.705570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486009b2-83ea-4e07-a55c-bf7f8e5608a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.706187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486009b2-83ea-4e07-a55c-bf7f8e5608a8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.706468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486009b2-83ea-4e07-a55c-bf7f8e5608a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.706738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486009b2-83ea-4e07-a55c-bf7f8e5608a8 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.708082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486009b2-83ea-4e07-a55c-bf7f8e5608a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:11.708082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486009b2-83ea-4e07-a55c-bf7f8e5608a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:11.710086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486009b2-83ea-4e07-a55c-bf7f8e5608a8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:11.735441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3914a3b-3e65-4952-836a-14b1b4d3bfb8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.758098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 240/496] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:47:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:11.758098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3008-e787-4924-a94b-fd058a6ede7f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.758098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3008-e787-4924-a94b-fd058a6ede7f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.758098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3008-e787-4924-a94b-fd058a6ede7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.775650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dc7d3008-e787-4924-a94b-fd058a6ede7f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:11.777177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc7d3008-e787-4924-a94b-fd058a6ede7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:11.782581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.783199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.783476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.783748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.784452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:11.784755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:11.786123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:11.796032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 257/497] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:11.796931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.819630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:11.852790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 241/498] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:11.864253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b0ed-7185-4bf5-b974-69865e1fe060 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.864253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b0ed-7185-4bf5-b974-69865e1fe060 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.864253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b0ed-7185-4bf5-b974-69865e1fe060 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.864253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 242/499] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:11.864253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8b0ed-7185-4bf5-b974-69865e1fe060 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:11.872439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:11.932374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ddc8-4f62-4134-9a2a-808770ff6648 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:11.972336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:11.972979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:11.973256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:11.973526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:11.990451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:11.991927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.004653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8b0ed-7185-4bf5-b974-69865e1fe060 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:12.008294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:12.009751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:12.011733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:12.011733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.011733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:12.014237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 258/500] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:12.016125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.054001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.054610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.054887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.055156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.107034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.144380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.146684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.148398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad10380-3077-45cd-a6f3-59bcd6b8733b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.163238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.188190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc6f47-5949-434c-9577-9eb935d5dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.188834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6f47-5949-434c-9577-9eb935d5dee1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.189116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6f47-5949-434c-9577-9eb935d5dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.189386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6f47-5949-434c-9577-9eb935d5dee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.200643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc6f47-5949-434c-9577-9eb935d5dee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.202118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc6f47-5949-434c-9577-9eb935d5dee1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c6dc6f47-5949-434c-9577-9eb935d5dee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:12.217714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:12.218730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:12.219567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:12.219567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.219567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:12.220253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 259/501] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:12.221614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26426e44-e016-4556-9468-b759af162e36 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.221886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26426e44-e016-4556-9468-b759af162e36 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.222153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26426e44-e016-4556-9468-b759af162e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.244949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-26426e44-e016-4556-9468-b759af162e36 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:12.246203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26426e44-e016-4556-9468-b759af162e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:12.260746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 243/502] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:12.261622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.324285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 260/503] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:12.324820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26426e44-e016-4556-9468-b759af162e36 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.375955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da1467-7e68-4f8d-945c-5ab9b91356ac None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.386975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.389720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.420854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.421379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.421657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.421926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.422935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:12.422935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.424288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.437527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 244/504] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:12.438493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.459219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26426e44-e016-4556-9468-b759af162e36 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.511172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.516089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.516089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.516089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.537312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.538801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:12.562166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:12.563218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:12.568500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:12.568500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.568500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:12.568500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 261/505] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:12.568500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.593875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a132-b61e-4800-85e5-8dd42aaab7a9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.632963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.633410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.633690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.633979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.635119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:12.635425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.636873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.651438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 245/506] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:12.652605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.682349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.693420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5088d7-b395-4ca1-b144-be00b36b14ed None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.694949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.733655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.734390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.734663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.734927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.746758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.748304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:12.766194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:12.767274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:12.768167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:12.768167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:12.768167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:12.768167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 262/507] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:12.768381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2fc9c-d231-4eb7-a98d-cd189a479749 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.768465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.809791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.810424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.810704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.810973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.818671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.820183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:12.834564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:12.836706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 246/508] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:12.837953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.886279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e85cc2-9d54-4c8c-89cb-6bf26d9f83fe None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.923733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.924477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.924818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.925148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:12.925934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:12.926297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:12.928005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:12.936388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.943179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 263/509] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:12.944072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:12.952337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e767c1e-8121-46e2-971c-e990097342f7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:12.966512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:12.991099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:12.991978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:12.992489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:12.992858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.007775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:13.015746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:13.016901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:13.017740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 247/510] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:13.018407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.065073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4a36f-2737-4ae1-bf9d-5fa476c9c08e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.102057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.102694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.102975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.103420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.110920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.112398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:13.124865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:13.126447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 264/511] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:13.128317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.137743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260e299-3b29-4031-a0ed-ff84cfe6f364 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.176857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.177458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.177725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.177999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.178634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:13.178926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.180332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.200336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 248/512] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:13.200336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.205785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:13.207286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:13.236223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dca72b-9a5f-4ec0-8a99-5511cc73b315 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.271382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.271987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.272296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.272575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.273294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:13.273602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.275625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.306694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3304f-c70e-4201-b2ab-01160decf5c9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.314397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 265/513] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:13.315255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.349025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.349641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.349917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.350183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.350828 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.352341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.375945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 249/514] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:47:13 2022] POST /identity/v3/users => generated 247 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:13.376820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.457983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c521a464-cd47-41db-be77-081fb1fea66c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.464163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:13.497364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:13.504492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.505107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.505504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.505763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.506451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:13.506755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.508242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.523477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 266/515] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:13.523477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.536952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a4e5c-ca82-41db-bf26-9434961fabf1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.582198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.583053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.583495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.583759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.584537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:13.585616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.587138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.611833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 250/516] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:13.611833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.699065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27d45-9fa2-4d79-b842-26585cd67894 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.732838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c828978-5238-4d3b-ac17-cf495b686374 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.746053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.746710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.746959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.747229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.755492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.757201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.761216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:13.773574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.774180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:13.774284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:13.775356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:13.777292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:13.777936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.777936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.778139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 267/517] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:13.778139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:13.852531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:13.862689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.864335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.914927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5fbc9-cc21-47a0-8d01-458024e67775 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:13.954788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:13.955470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:13.955768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:13.956036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:13.969155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:13.972063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:13.988485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:13.990015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:13.991678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:13.991678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:13.991678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:13.994680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 268/518] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:13.995265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.010517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 251/519] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:14.011740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.041846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:14.128625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da97b67-4ac7-438e-a932-791c7412b4fe None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:14.140755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:14.149147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431955f6-bbf0-4d49-b745-0a50b25a2885 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:14.187597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:14.188347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:14.188696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:14.189067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:14.195373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:14.196082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:14.196369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:14.196640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:14.198165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:14.198626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:14.200678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:14.221798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 252/520] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:14.222891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.282902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:14.284326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:14.330574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:14.353834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311d6f3-daf2-4515-b8f3-e6c7eda3ff4a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:14.403014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:14.403632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:14.403906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:14.404208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:14.405143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:14.405322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 269/521] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:14.405735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.409637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:14.411093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:14.414717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:14.424970 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 253/522] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:14.430017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.560218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f26ab-4ad1-4f9a-a3a9-c72ff064d09c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:14.562474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287010d2-5d24-432e-b862-b9dc6e48f6db None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:14.602205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:14.602814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:14.603652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:14.603930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:14.604694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=3faaacdf2ff54c06bb4eebf13533a72a) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:14.604999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:14.606441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:14.611092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:14.611744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:14.612039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:14.620153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:14.620616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 254/523] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/role_assignments?user.id=3faaacdf2ff54c06bb4eebf13533a72a&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:14.620616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.632630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:14.646157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:14.649145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:14.679538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:14.680581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:14.682500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:14.682500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:14.682500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:14.682500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 270/524] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:14.683406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.773045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6378859-b240-4dce-84c7-c74dfe66f5c8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:14.780479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:14.829837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6b3f-2bc3-4a5e-9e97-54236fa08c0a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:14.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:14.836549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:14.836831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:14.837105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:14.861823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:14.863971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:14.878202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:14.878836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:14.879115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:14.879384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:14.886171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:14.887201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:14.888081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:14.888081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:14.888081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:14.894245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 255/525] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:14.894245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.895041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:14.896488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:14.913265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:14.914263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 12:47:14.915152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:14.917566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 271/526] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:14.918690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:14.977135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.019252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32021e-1792-4a9f-9df0-a7b9715920a1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.044675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198bc05-d41e-438d-b062-ec71504b5476 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.059527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.060179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.060466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.060811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.061579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:15.061893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.063393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.066733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.084573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 256/527] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:15.085446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.087113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.087991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.088569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.088973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.089867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:15.090310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.091818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.110086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 272/528] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:15.111352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.199759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968cd76-e272-407f-b65f-c87b71ec4e61 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.219648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.239065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.239696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.239977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.240283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.241032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:15.241336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.242802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.257925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7085fe-4348-4b84-8389-53f172004f18 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.268055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 257/529] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:15.269048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.303658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.304329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.304606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.304881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.312838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.314441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:15.328455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:15.329368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 273/530] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:15.330647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.378189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.387609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc1082-db83-4283-9300-444920f1b9df None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.426081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.426770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.427002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.427280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.436031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.437538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:15.451531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:15.452676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:15.453554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 258/531] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:15.454018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.454513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d979a51-060f-409e-8cbf-86249caaa738 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.494398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.496141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.496996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.497557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.498017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.569913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ac3f1-b9b3-452a-b94c-0f2baa6bb635 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.582635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.584436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.611206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639700-120d-4310-913f-49f380f939f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.611840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639700-120d-4310-913f-49f380f939f9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.612156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639700-120d-4310-913f-49f380f939f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.612433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02639700-120d-4310-913f-49f380f939f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.613170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639700-120d-4310-913f-49f380f939f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:15.613480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639700-120d-4310-913f-49f380f939f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.615580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02639700-120d-4310-913f-49f380f939f9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.639305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 259/532] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:15.639305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639700-120d-4310-913f-49f380f939f9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.649711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.726042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 274/533] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:15.726042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.759109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.766440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02639700-120d-4310-913f-49f380f939f9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.813695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.814371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.814609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.814845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.816062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:15.816062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.817356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.836903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 260/534] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:15.836903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.855293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae89655-0412-44cf-9daa-3c02811388ef None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:15.905639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1465550-6a2e-4c96-ba1c-211a40461e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:15.906181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1465550-6a2e-4c96-ba1c-211a40461e42 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.906451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1465550-6a2e-4c96-ba1c-211a40461e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.906686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1465550-6a2e-4c96-ba1c-211a40461e42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.907398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1465550-6a2e-4c96-ba1c-211a40461e42 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=59b299d3239e4f53912477d94975d9ba) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:15.907759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1465550-6a2e-4c96-ba1c-211a40461e42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:15.909155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1465550-6a2e-4c96-ba1c-211a40461e42 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:15.916440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 275/535] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/role_assignments?user.id=59b299d3239e4f53912477d94975d9ba&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:15.917767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95924-91a3-4a47-8668-9ef4b0e56a01 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:15.918053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95924-91a3-4a47-8668-9ef4b0e56a01 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:15.918676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a95924-91a3-4a47-8668-9ef4b0e56a01 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:15.919955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 276/536] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:15.922831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95924-91a3-4a47-8668-9ef4b0e56a01 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:15.927702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:15.980925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5235cd3-ab9d-497e-9ca2-852ebdb6fc2d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:16.032424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e277419-0128-49c2-bb1f-b90f3c7860c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:16.033164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e277419-0128-49c2-bb1f-b90f3c7860c5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:16.033164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e277419-0128-49c2-bb1f-b90f3c7860c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:16.033783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e277419-0128-49c2-bb1f-b90f3c7860c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:16.053865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e277419-0128-49c2-bb1f-b90f3c7860c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:16.056164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e277419-0128-49c2-bb1f-b90f3c7860c5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5e277419-0128-49c2-bb1f-b90f3c7860c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:16.085717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:16.086787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:16.088548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:16.088548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:16.088548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:16.096443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a95924-91a3-4a47-8668-9ef4b0e56a01 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:16.096664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 261/537] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:16.098742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065531-5675-40f9-9c2c-928ee0974ed8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:16.099186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065531-5675-40f9-9c2c-928ee0974ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:16.099671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065531-5675-40f9-9c2c-928ee0974ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:16.130127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-62065531-5675-40f9-9c2c-928ee0974ed8 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:16.131919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-62065531-5675-40f9-9c2c-928ee0974ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:16.136396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:16.141312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:16.142290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:16.142721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:16.143140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:16.145539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=05fad60cd02c4c2295beb15783aecfc1) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:16.146025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:16.148626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:16.157847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 277/538] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:15 2022] GET /identity/v3/role_assignments?user.id=05fad60cd02c4c2295beb15783aecfc1&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:16.159010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:16.247014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 262/539] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:16.268268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:16.327871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c91c-61d6-49fa-8c66-fadce4846465 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:16.381068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:16.382098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:16.382612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:16.383107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:16.383998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:16.384597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:16.386320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:16.406612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 278/540] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:16.412708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62065531-5675-40f9-9c2c-928ee0974ed8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:16.529985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62065531-5675-40f9-9c2c-928ee0974ed8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:16.572428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:16.573458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:16.573966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:16.574438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:16.582641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:16.584452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:16.586712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:16.599003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:16.599922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:16.600857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:16.603413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 263/541] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:16.609322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:16.668849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:16.818528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebcac-b040-4fdd-adbf-1849c170126d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:16.900755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:16.914607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:16.916441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:16.916728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:16.917759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:16.918519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:16.918832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:16.920437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:16.924779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5974b8-cd9a-46bd-b094-e7f5c466b4a4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:16.960138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 279/542] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:16.966783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:16.991680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:16.992352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:16.992631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:16.992959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.015236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:17.022327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:17.023288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:17.024150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:17.032071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 264/543] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:17.034500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:17.105264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:17.123062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d8e5-c1a7-4eb7-abee-7f5fc2584b57 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:17.153105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb2284-c88e-475b-a589-6fcb10d74fd7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:17.159115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7342753-011d-4321-9c87-95ac2cc17fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:17.159738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7342753-011d-4321-9c87-95ac2cc17fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:17.160038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7342753-011d-4321-9c87-95ac2cc17fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:17.164566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7342753-011d-4321-9c87-95ac2cc17fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.165985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7342753-011d-4321-9c87-95ac2cc17fb8 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=f5ca117fa96d412e9bda506591a01fbe) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:17.166321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7342753-011d-4321-9c87-95ac2cc17fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:17.168417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7342753-011d-4321-9c87-95ac2cc17fb8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:17.175873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 280/544] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:16 2022] GET /identity/v3/role_assignments?user.id=f5ca117fa96d412e9bda506591a01fbe&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:17.177705 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f848e-c13b-4bd4-aa06-57ac219d7f17 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:17.177995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f848e-c13b-4bd4-aa06-57ac219d7f17 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:17.178275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f848e-c13b-4bd4-aa06-57ac219d7f17 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.184295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 281/545] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:17.187576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b193c-e25e-4684-9d79-68c7231ef98e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:17.187901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b193c-e25e-4684-9d79-68c7231ef98e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:17.188172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b193c-e25e-4684-9d79-68c7231ef98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.218128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:17.218762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:17.219041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:17.219312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.220006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:17.220340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:17.222181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:17.228760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-657b193c-e25e-4684-9d79-68c7231ef98e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:17.230112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-657b193c-e25e-4684-9d79-68c7231ef98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:17.249470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 265/546] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:17.257209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:17.338160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:17.375344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 282/547] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:17.450808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45445cc2-f901-42dd-a6d1-5919047cd853 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:17.472991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:17.489153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:17.489786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:17.490065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:17.490333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.501918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:17.503386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:17.519229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:17.520276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:17.521249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:17.521249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:17.521249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:17.521249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 266/548] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:17.526538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b193c-e25e-4684-9d79-68c7231ef98e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:17.678218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b193c-e25e-4684-9d79-68c7231ef98e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:17.692262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:17.718852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:17.719393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:17.719701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:17.719979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.720652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:17.720956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:17.722336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:17.750673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 283/549] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:17.756620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:17.864006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:17.865526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57163-9ff2-41ae-9eaa-77ba661d2e0e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:17.942857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:17.944369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:17.944855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:17.945340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:17.971127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:17.979667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:17.980900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:17.981718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:17.987555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 267/550] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:17.996880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:18.005678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae2092-690c-4f28-9ac2-2cb4b0e80ff9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:18.062694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:18.073190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:18.073838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.074121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.074395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.082802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:18.084241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:18.097709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:18.098925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:18.099850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 284/551] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:18.104782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:18.227565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140d1ab-5ca3-466e-aa84-3c91dcabe3c9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:18.275824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:18.280227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84390586-fcfc-4ffb-ad77-bedcee7b795d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:18.292137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:18.292821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.293103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.293373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.294041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:18.294343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:18.295724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:18.304855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 268/552] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:18.310751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:18.338242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:18.338878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.339152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.339422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.340280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:18.342304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:18.342304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:18.364856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 285/553] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Sep 14 12:47:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:18.370615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:18.493052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:18.501164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66a59c-f613-44fb-9fb3-3271be865e69 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:18.541166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1e480-be69-484e-bc04-fcdba516515f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:18.542612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84ca5e-3f75-4b53-9c34-245eee9f2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:18.543510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ca5e-3f75-4b53-9c34-245eee9f2f28 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.543893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ca5e-3f75-4b53-9c34-245eee9f2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.544291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84ca5e-3f75-4b53-9c34-245eee9f2f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.557355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84ca5e-3f75-4b53-9c34-245eee9f2f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:18.559443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84ca5e-3f75-4b53-9c34-245eee9f2f28 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5e84ca5e-3f75-4b53-9c34-245eee9f2f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:18.579153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:18.580675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:18.581663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:18.581663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:18.581663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:18.581663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 269/554] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:18.582044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:18.583324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.583482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a077b5-b256-4a87-8fe1-7a205c7b69fb None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.583632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.583780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a077b5-b256-4a87-8fe1-7a205c7b69fb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.583911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.584077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a077b5-b256-4a87-8fe1-7a205c7b69fb None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.588187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 270/555] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:18.592334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a077b5-b256-4a87-8fe1-7a205c7b69fb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:18.627564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:18.687720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:18.689369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:18.752785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a077b5-b256-4a87-8fe1-7a205c7b69fb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:18.802140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63c0fd-9fb1-44a1-a684-41ffeb23487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:18.803706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c0fd-9fb1-44a1-a684-41ffeb23487e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.804222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c0fd-9fb1-44a1-a684-41ffeb23487e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.805059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63c0fd-9fb1-44a1-a684-41ffeb23487e None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.807293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63c0fd-9fb1-44a1-a684-41ffeb23487e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:18.808521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63c0fd-9fb1-44a1-a684-41ffeb23487e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:18.812305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63c0fd-9fb1-44a1-a684-41ffeb23487e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:18.831184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 271/556] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:18.833125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3bc20-3a11-4e35-a53f-aa6f66ac3245 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:18.833528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3bc20-3a11-4e35-a53f-aa6f66ac3245 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:18.833806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3bc20-3a11-4e35-a53f-aa6f66ac3245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:18.841933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 286/557] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:18.843241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:18.848784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:18.861607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ead3bc20-3a11-4e35-a53f-aa6f66ac3245 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:18.863220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ead3bc20-3a11-4e35-a53f-aa6f66ac3245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:18.913718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:18.976069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 272/558] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:18.976069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3bc20-3a11-4e35-a53f-aa6f66ac3245 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:18.982513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea3ce4-9c8b-4a81-9145-11a195d6cb72 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.066639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af324158-4d13-4745-b918-c20442193b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.067276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af324158-4d13-4745-b918-c20442193b8f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.067528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af324158-4d13-4745-b918-c20442193b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.067749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af324158-4d13-4745-b918-c20442193b8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.079936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af324158-4d13-4745-b918-c20442193b8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:19.085443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af324158-4d13-4745-b918-c20442193b8f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-af324158-4d13-4745-b918-c20442193b8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:19.105581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:19.106628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:19.107609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:19.108218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 287/559] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:47:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:19.109592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2d4e-dbf5-4b73-8d7d-e02f2d1e7d5c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.109592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2d4e-dbf5-4b73-8d7d-e02f2d1e7d5c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.109875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2d4e-dbf5-4b73-8d7d-e02f2d1e7d5c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.111603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 288/560] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:19.112336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2d4e-dbf5-4b73-8d7d-e02f2d1e7d5c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.169451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3bc20-3a11-4e35-a53f-aa6f66ac3245 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.217026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2abc7-5130-4760-abfe-ec50f4993826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.217673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2abc7-5130-4760-abfe-ec50f4993826 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.217953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2abc7-5130-4760-abfe-ec50f4993826 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.218486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2abc7-5130-4760-abfe-ec50f4993826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.222457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:19.234469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2abc7-5130-4760-abfe-ec50f4993826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:19.236900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2abc7-5130-4760-abfe-ec50f4993826 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:19.243539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2d4e-dbf5-4b73-8d7d-e02f2d1e7d5c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-34c2abc7-5130-4760-abfe-ec50f4993826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:19.257521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:19.258708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:19.260305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:19.260305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:19.260305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:19.262472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 273/561] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:19.264234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae583-2582-484e-944b-8d735317aa99 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.264680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae583-2582-484e-944b-8d735317aa99 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.265327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aae583-2582-484e-944b-8d735317aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.266395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:19.292078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.292801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.292980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-91aae583-2582-484e-944b-8d735317aa99 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:19.293413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.293695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.294350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-91aae583-2582-484e-944b-8d735317aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:19.294462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:19.294766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:19.296232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:19.320230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 289/562] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:19.321859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.384069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 274/563] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:19.384069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aae583-2582-484e-944b-8d735317aa99 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.478032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfc315-1fc6-4cfe-8239-d27c923fddb7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.510937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aae583-2582-484e-944b-8d735317aa99 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.523339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.524333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.525351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.525818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.526655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:19.527436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:19.529049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:19.535753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:19.543082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 290/564] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:19.544429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.561007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.561962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.562253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.562527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.576556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:19.581872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:19.582836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 275/565] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:19.584395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.590549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:19.668329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0967f-cfda-43e5-935d-a3d919e2dc82 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.711739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.712982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.713259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.713532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.720893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07875f9-d55a-43bc-88ae-557c640f06f7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.725718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:19.727630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:19.744312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:19.745333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:19.751475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:19.751475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:19.751475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:19.751475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 291/566] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:19.751475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.766868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.767572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.767780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.768074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.777587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:19.779058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:19.791644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:19.793510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 276/567] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:19.795285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.840464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:19.850750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:19.863711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ac7e4-a488-4281-9538-7acae03e8755 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.898280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.898889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.899167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.899441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.901070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:19.901435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:19.903067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:19.906445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5788004-882f-45fb-8e53-8c91b611a8a7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:19.911435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 292/568] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:19.912309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:19.945703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb3fe4-7f55-42b6-8f1a-1fa6f9c11b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:19.946349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3fe4-7f55-42b6-8f1a-1fa6f9c11b0a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.947178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3fe4-7f55-42b6-8f1a-1fa6f9c11b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.947574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb3fe4-7f55-42b6-8f1a-1fa6f9c11b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.965619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb3fe4-7f55-42b6-8f1a-1fa6f9c11b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d3eb3fe4-7f55-42b6-8f1a-1fa6f9c11b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:19.970577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:19.971837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:19.972702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 277/569] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:19.973419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100afe-d8d0-4cbd-966d-b5815654b804 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:19.973419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100afe-d8d0-4cbd-966d-b5815654b804 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:19.973551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100afe-d8d0-4cbd-966d-b5815654b804 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:19.975316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 278/570] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:19.976169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31100afe-d8d0-4cbd-966d-b5815654b804 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.049040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3ff5d-9682-4111-80d9-008cbc7678f1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.095342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.095983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.096343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.096558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.096879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.097492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:20.097859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.099258 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.100902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31100afe-d8d0-4cbd-966d-b5815654b804 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.111695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 293/571] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:20.112585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.124607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.139275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.139891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.140202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.140476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.141163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:20.141469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.142949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.156399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 279/572] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:20.157249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.217825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30723c67-ebd0-45a0-9165-f2ebaef17f53 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.253926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef847b9-893c-473e-a1c9-a391fa6d78a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.254557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef847b9-893c-473e-a1c9-a391fa6d78a1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.254832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef847b9-893c-473e-a1c9-a391fa6d78a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.255274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef847b9-893c-473e-a1c9-a391fa6d78a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.264635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c59f43-a09b-4405-aaab-06e9b14d1b60 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.265623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef847b9-893c-473e-a1c9-a391fa6d78a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.267134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef847b9-893c-473e-a1c9-a391fa6d78a1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1ef847b9-893c-473e-a1c9-a391fa6d78a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:20.283423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:20.284619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:20.285513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:20.285513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:20.285513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:20.285513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 294/573] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:20.286365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c48d6-0281-4044-ba83-b8fb7ecd4c73 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.286488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c48d6-0281-4044-ba83-b8fb7ecd4c73 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.286777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c48d6-0281-4044-ba83-b8fb7ecd4c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.302276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.302890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.303168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.303440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.304142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:20.304452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.305860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.306205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0c5c48d6-0281-4044-ba83-b8fb7ecd4c73 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:20.307413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c5c48d6-0281-4044-ba83-b8fb7ecd4c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:20.314617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 280/574] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:20.315264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.338064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.371145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.381699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 295/575] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:20.382530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c48d6-0281-4044-ba83-b8fb7ecd4c73 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.439564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d10d1-41cb-4807-9540-2d5ab858de62 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.488273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.489302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.489576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.489848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.497474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.498938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:20.511902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:20.512925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:20.513818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:20.517841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 281/576] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:20.518014 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c48d6-0281-4044-ba83-b8fb7ecd4c73 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.518675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.558504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.559293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.559566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.560701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.561443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=59ec11c9fac7430c927f894959023e36) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:20.561755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.563252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.576077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 296/577] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/role_assignments?user.id=59ec11c9fac7430c927f894959023e36&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:20.576077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.646496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.663739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.673897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c553f45-0117-4b8a-9da5-fb0fe97cbca8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.713704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.714437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.714789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.715065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.715737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:20.716072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.717647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.722660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208606e7-3f1b-47de-a407-89f3e7415462 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.732076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 282/578] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:20.732956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.770540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.772144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.772750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.772903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.786786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.788571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:20.806520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:20.807677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:20.808602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:20.808602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:20.808602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:20.808602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 297/579] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:20.808839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.861728 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5413d-eb86-4c8f-897d-f59a58401a4b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.903152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.903881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.904373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.904815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.905658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:20.906087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:20.907941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:20.920154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.924277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 283/580] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:20.925151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:20.936305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddcb6-0f7f-4cc4-99fe-20eea11a65bc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:20.947309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:20.977032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:20.977761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:20.978720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:20.979064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:20.991492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:20.997357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:20.998549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:20.999675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:21.000883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 298/581] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:21.003706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.068742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d547-e6d7-4bc8-8a12-5e682b3917ed None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.123922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.124630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.125003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.125183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.135879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.137494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:21.153074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:21.154266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 12:47:21.155332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:21.156416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 284/582] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:21.158998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.205770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da6af-5e7a-4412-a302-df13e107cdc4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.246783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:21.256486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.257376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.257653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.257937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.258625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:21.258963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.260824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.285010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 299/583] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:21.285010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.308773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec46c5-47c3-4169-9333-f7bb8297eda0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.327599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:21.357099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.358001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.358386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.358763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/3faaacdf2ff54c06bb4eebf13533a72a/roles/67bbea02b9dc4cc392c0ac937749dc57` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.380083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=3faaacdf2ff54c06bb4eebf13533a72a, role_id=67bbea02b9dc4cc392c0ac937749dc57)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.381809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.401554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 285/584] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:21 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/3faaacdf2ff54c06bb4eebf13533a72a/roles/67bbea02b9dc4cc392c0ac937749dc57 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:21.402605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.481202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db784525-85cc-477e-9f83-8bf9038929c2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.530972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.531711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.532092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.533138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.533907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:21.534397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.535874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.552030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 300/585] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:21.553564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.572732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb845-ac38-4aa0-b64d-f3a66fb59df6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.591938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:21.628430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.629293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.629718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.630135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.631057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:21.631500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.633129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.656877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 286/586] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:21.658031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.679545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:21.693858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10347e81-7930-4dfb-a3ac-b4f5689ed4be None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.740648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.741214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.741500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.741775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.752507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.754538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:21.770234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:21.771452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:21.772682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 301/587] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:21.776759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.785615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee05d-a6bb-4657-93a2-b4a373a7c301 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.826633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.827518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.828093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.828992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.841419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.843194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:21.861144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:21.862388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:21.863329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:21.863329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:21.863329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:21.865467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 287/588] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:21.866520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:21.893935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:21.906132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056d9c6-bd85-4a4e-bbce-bf2d780d9f3f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:21.953683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:21.954332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:21.954610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:21.954885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:21.969487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:21.971413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:21.991584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:21.992760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:21.994389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:21.994389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:21.994389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:21.994389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 302/589] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:21.996931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.000791 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:22.006911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d0059-6f8b-4996-98a4-cbb816573799 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.047276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.048136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.048432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.048869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.049616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:22.049964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.051812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.084544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 288/590] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:22.086482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.145113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895942db-fcc8-450c-909c-529fa1267ab2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.183174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.183702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:22.183881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.184405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.185400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.186583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:22.187091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.189017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.205554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 303/591] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:22.206445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.214448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a86a5-0100-4662-935c-6a71acf14a31 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.256583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.257640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.258141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.258661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.259948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:22.260579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.262386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.274108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:22.283055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 289/592] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:22.284809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.320619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7fd0f-0246-4fdd-9c50-6040491d7b90 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.358912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.359549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.359823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.360120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.373197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.374831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:22.391182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:22.392384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:22.393292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:22.393292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:22.393292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:22.397423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 304/593] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:22.398347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.418533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0bb5c-91c5-46f7-8e18-67363ba04875 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.457485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.458481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.458980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.459447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.470102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.472128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.474388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:22.488300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:22.489321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 12:47:22.490271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:22.492976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 290/594] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:22.494575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.509510 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c78f6-0179-4c61-9511-3079df8365d7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.523684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:22.547587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.548200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.548476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.548744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.557029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.558467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:22.570627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:22.571778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:22.573262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:22.576466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 305/595] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:22.577314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.623759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed900fd8-3f6e-4062-b8f2-7fd3147313ec None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.670772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.671804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.672341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.672813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.673734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:22.674255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.675907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.689975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 291/596] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:22.691164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.701681 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264befb-0dd2-4a17-9ce2-e34bfdc3aed6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.751005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.752753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.753242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.753530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.754634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:22.755446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.757653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.776457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:22.785576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 306/597] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:22.786435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.825186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:22.836138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c6d7b-ae40-46f9-90f7-fd20a5088eb2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.875293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.875898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.876244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.876518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.877203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:22.877506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.878919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.890954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 292/598] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:22.892054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:22.914499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2333f-f2ea-4e0f-b693-9133e165bd5c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:22.957600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9c8bc-8515-49ec-bd38-eb77f7f32765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:22.958403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9c8bc-8515-49ec-bd38-eb77f7f32765 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.958684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9c8bc-8515-49ec-bd38-eb77f7f32765 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.959279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9c8bc-8515-49ec-bd38-eb77f7f32765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.968055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9c8bc-8515-49ec-bd38-eb77f7f32765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:22.970552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd9c8bc-8515-49ec-bd38-eb77f7f32765 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9cd9c8bc-8515-49ec-bd38-eb77f7f32765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:22.983902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:22.985055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 307/599] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc6b4-a8b6-4d0f-a2ae-a99142430c8c None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:22.991010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc6b4-a8b6-4d0f-a2ae-a99142430c8c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:22.991604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cc6b4-a8b6-4d0f-a2ae-a99142430c8c None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:22.991604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 308/600] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:22.991604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cc6b4-a8b6-4d0f-a2ae-a99142430c8c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.006102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539a7ca-9265-4685-8790-bcc5f2d6e9ee None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.030706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:23.051428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.052250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.052587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.052930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.066654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:23.068552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:23.086104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:23.088274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:23.089187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:23.089187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:23.089187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:23.093581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 293/601] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:23.094433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.103098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:23.114613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cc6b4-a8b6-4d0f-a2ae-a99142430c8c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.156707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328c78e-ff4a-41b3-9c96-4e06099e4182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.157367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c78e-ff4a-41b3-9c96-4e06099e4182 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.157645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c78e-ff4a-41b3-9c96-4e06099e4182 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.157918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c78e-ff4a-41b3-9c96-4e06099e4182 None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/59b299d3239e4f53912477d94975d9ba/roles/67bbea02b9dc4cc392c0ac937749dc57` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.173682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328c78e-ff4a-41b3-9c96-4e06099e4182 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=59b299d3239e4f53912477d94975d9ba, role_id=67bbea02b9dc4cc392c0ac937749dc57)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:23.175116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328c78e-ff4a-41b3-9c96-4e06099e4182 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:23.189997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 309/602] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:22 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/59b299d3239e4f53912477d94975d9ba/roles/67bbea02b9dc4cc392c0ac937749dc57 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:23.191292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a43d1-32c1-4354-aa1f-5b85e4491f43 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.191571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a43d1-32c1-4354-aa1f-5b85e4491f43 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.191902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a43d1-32c1-4354-aa1f-5b85e4491f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.218220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269b1dc-5cd4-4105-ab70-0543f1c69664 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.219563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-792a43d1-32c1-4354-aa1f-5b85e4491f43 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:23.221381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-792a43d1-32c1-4354-aa1f-5b85e4491f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:23.263118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.263832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.264600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.264600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.265240 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:23.265552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:23.267260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:23.288602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 294/603] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:23.289614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.324855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 310/604] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:23.324855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a43d1-32c1-4354-aa1f-5b85e4491f43 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.354544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:23.444872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:23.467801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a43d1-32c1-4354-aa1f-5b85e4491f43 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.474392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd56a75-2505-417e-9f72-38ec4b480c52 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.514665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.515009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.515581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.515860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.516161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.516631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.516845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:23.517285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:23.517532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.517996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/05fad60cd02c4c2295beb15783aecfc1/roles/67bbea02b9dc4cc392c0ac937749dc57` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.518909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:23.539162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 295/605] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:23.539349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=05fad60cd02c4c2295beb15783aecfc1, role_id=67bbea02b9dc4cc392c0ac937749dc57)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:23.539349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:23.541557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.577495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 311/606] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:23 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/05fad60cd02c4c2295beb15783aecfc1/roles/67bbea02b9dc4cc392c0ac937749dc57 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:23.667182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:23.679674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d542c6-6e10-43c7-b620-a2c2145bb1e2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.730220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.732715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.733917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.735359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.735808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.752277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:23.753769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:23.775334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:23.776347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:23.777510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:23.778464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 296/607] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:23.786574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.908005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f9888-3c5a-4805-aef2-45a6c6c9c1db None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.934182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:23.948696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64f682-3ef3-41f2-8a95-271a01c6c53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.949450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64f682-3ef3-41f2-8a95-271a01c6c53d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.949734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64f682-3ef3-41f2-8a95-271a01c6c53d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.950011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64f682-3ef3-41f2-8a95-271a01c6c53d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.950347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98dc99-be12-4e95-b30f-d104d9489e67 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:23.962425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64f682-3ef3-41f2-8a95-271a01c6c53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2b64f682-3ef3-41f2-8a95-271a01c6c53d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:23.967524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:23.968568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:23.969883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 312/608] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:23.970594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1156ee-938c-482b-bbee-da6cec1362a0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.970594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1156ee-938c-482b-bbee-da6cec1362a0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:23.970981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1156ee-938c-482b-bbee-da6cec1362a0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:23.977704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 313/609] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:23.978579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1156ee-938c-482b-bbee-da6cec1362a0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:23.997035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb5ba4-282e-487a-8ba8-8fe204edc55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:23.997706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5ba4-282e-487a-8ba8-8fe204edc55a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:23.997992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5ba4-282e-487a-8ba8-8fe204edc55a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:24.002600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb5ba4-282e-487a-8ba8-8fe204edc55a None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:24.003771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb5ba4-282e-487a-8ba8-8fe204edc55a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:24.004172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb5ba4-282e-487a-8ba8-8fe204edc55a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:24.006026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb5ba4-282e-487a-8ba8-8fe204edc55a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:24.021067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 297/610] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:24.022354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526337e-a96a-43c6-aa03-e7a6acf941f3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:24.022643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526337e-a96a-43c6-aa03-e7a6acf941f3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:24.022920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526337e-a96a-43c6-aa03-e7a6acf941f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:24.044286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0526337e-a96a-43c6-aa03-e7a6acf941f3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:24.046123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0526337e-a96a-43c6-aa03-e7a6acf941f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:24.049460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:24.128383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1156ee-938c-482b-bbee-da6cec1362a0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:24.137361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 298/611] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:24.138223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526337e-a96a-43c6-aa03-e7a6acf941f3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:24.199821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:24.208675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:24.209010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:24.209240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:24.209956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:24.210370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:24.211917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:24.230314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 314/612] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:24.236292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:24.317969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526337e-a96a-43c6-aa03-e7a6acf941f3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:24.352397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:24.390999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703af2c1-7523-450a-9348-a18746f82158 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:24.431977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:24.432679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:24.432965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:24.433243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:24.440830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:24.441514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:24.441795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:24.442066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/f5ca117fa96d412e9bda506591a01fbe/roles/67bbea02b9dc4cc392c0ac937749dc57` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:24.445944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:24.448267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:24.472393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:24.473811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:24.474864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:24.474864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:24.474864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:24.474864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 315/613] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:24.474864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:24.480735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:24.486587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=f5ca117fa96d412e9bda506591a01fbe, role_id=67bbea02b9dc4cc392c0ac937749dc57)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:24.488782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:24.506679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 299/614] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:24 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/f5ca117fa96d412e9bda506591a01fbe/roles/67bbea02b9dc4cc392c0ac937749dc57 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:24.508223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:24.636054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:24.647960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2d99b-5e80-4dcc-a0a7-d6210125033a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:24.734853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53231d0f-88a2-4909-adf0-050e54dd6233 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:24.736663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:24.737341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:24.737611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:24.737893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:24.762553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:24.769815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:24.770794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:24.771617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 316/615] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:24.779142 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:24.789523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:24.791229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:24.791758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:24.794518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:24.795450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:24.796421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:24.798322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:24.814667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 300/616] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:24.824054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:24.896169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:24.986503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504138-0f82-4de8-8e4c-83cedd9ee915 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:25.011424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b0c2-cc0d-4fbd-9c2e-6492f7a072a3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:25.062309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:25.064686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:25.066038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:25.067295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:25.068282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:25.069141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:25.072365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:25.089637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 317/617] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:25.094428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:25.094428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:25.094428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:25.094428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:25.096154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:25.102185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:25.104048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:25.123364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:25.124440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:25.125402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:25.128756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 301/618] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:25.132227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:25.137457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:25.295152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd0edc-59d3-4445-9f1f-8408bf0c3fdc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:25.342495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec9380-fb5c-49cb-b3b3-684b8e21ad0d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:25.356964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:25.373288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:25.374276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:25.374762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:25.375269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:25.396923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:25.399101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:25.405648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:25.406558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:25.407047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:25.411510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:25.412622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:25.413144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:25.414829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:25.434428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:25.435471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:25.436427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:25.436427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:25.436427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:25.439611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 318/619] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:25.450914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:25.462798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 302/620] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Sep 14 12:47:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:25.469791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:25.564559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:25.600959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3ad21-9e13-44fa-b158-4feb863cd834 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:25.677344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:25.678315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:25.678820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:25.679286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:25.680153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:25.681328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:25.682984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:25.710091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebf00c-3237-47c8-95a5-af565496dde3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:25.710779 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 319/621] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:25.713969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:25.800859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:25.802358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:25.802914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:25.803417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:25.826365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:25.829330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:25.858052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:25.859067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:25.859987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:25.859987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:25.859987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:25.869953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 303/622] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:25.872558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:25.910180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:25.917207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e870db-d69a-437b-a10a-53f9e0036752 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:25.957946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:25.957946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:25.958545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:25.958826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:25.959106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:25.974365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:25.980049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:25.992274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:25.993533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:25.994514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 320/623] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:47:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:26.000164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:26.078354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ce7f-6931-4772-8c2f-6876abcc1fcf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:26.116777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a9db5-6663-4a3e-94fd-9e306acadcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:26.117756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9db5-6663-4a3e-94fd-9e306acadcd0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.118403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9db5-6663-4a3e-94fd-9e306acadcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.119250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a9db5-6663-4a3e-94fd-9e306acadcd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.120217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9db5-6663-4a3e-94fd-9e306acadcd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:26.120739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9db5-6663-4a3e-94fd-9e306acadcd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:26.127475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf1fa8-7aa9-4a62-b825-34583a5d9d65 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:26.130459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a9db5-6663-4a3e-94fd-9e306acadcd0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:26.148852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 304/624] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:26.151667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31f58-7a5c-4a57-a161-9833b4c03501 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.152446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31f58-7a5c-4a57-a161-9833b4c03501 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.152941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a31f58-7a5c-4a57-a161-9833b4c03501 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.158865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 305/625] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:26.160178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31f58-7a5c-4a57-a161-9833b4c03501 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:26.183795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab932bb3-7571-45af-8cc1-7dca4601bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:26.184481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932bb3-7571-45af-8cc1-7dca4601bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.184727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932bb3-7571-45af-8cc1-7dca4601bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.185003 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab932bb3-7571-45af-8cc1-7dca4601bcd4 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.185743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932bb3-7571-45af-8cc1-7dca4601bcd4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:26.186198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932bb3-7571-45af-8cc1-7dca4601bcd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:26.189894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab932bb3-7571-45af-8cc1-7dca4601bcd4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:26.207695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 321/626] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:47:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:26.213429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778758d7-8134-481d-9dc0-bd53c652e74d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.213710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778758d7-8134-481d-9dc0-bd53c652e74d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.213995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778758d7-8134-481d-9dc0-bd53c652e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.234019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-778758d7-8134-481d-9dc0-bd53c652e74d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:26.235205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-778758d7-8134-481d-9dc0-bd53c652e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:26.260560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:26.284095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a31f58-7a5c-4a57-a161-9833b4c03501 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:26.293114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:26.319318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 322/627] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:26.329230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcfebc-7373-4e7d-8cbe-9cf703025f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:26.329889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4229ba-a459-44d1-a2c2-0f720ea66486 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.330015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcfebc-7373-4e7d-8cbe-9cf703025f63 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.330387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcfebc-7373-4e7d-8cbe-9cf703025f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.330608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4229ba-a459-44d1-a2c2-0f720ea66486 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.330866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcfebc-7373-4e7d-8cbe-9cf703025f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.331191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4229ba-a459-44d1-a2c2-0f720ea66486 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.333212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 323/628] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:26.334097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4229ba-a459-44d1-a2c2-0f720ea66486 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:26.344711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcfebc-7373-4e7d-8cbe-9cf703025f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:26.346392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcfebc-7373-4e7d-8cbe-9cf703025f63 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-61dcfebc-7373-4e7d-8cbe-9cf703025f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:26.360207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:26.361465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:26.362600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:26.368131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 306/629] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:26.368131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28c65b-de6b-4b13-aea9-d77a93e0b6be None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.368131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28c65b-de6b-4b13-aea9-d77a93e0b6be None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.368131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28c65b-de6b-4b13-aea9-d77a93e0b6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.387808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1a28c65b-de6b-4b13-aea9-d77a93e0b6be None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:26.389149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1a28c65b-de6b-4b13-aea9-d77a93e0b6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:26.475758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 307/630] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:26.477012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28c65b-de6b-4b13-aea9-d77a93e0b6be None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:26.488251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4229ba-a459-44d1-a2c2-0f720ea66486 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:26.535421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:26.536388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.537418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.537925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.600094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:26.614620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:26.646975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:26.649189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:26.669997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28c65b-de6b-4b13-aea9-d77a93e0b6be None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:26.709700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:26.710245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.710524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.710793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.711533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:26.711988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:26.713675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:26.732513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 308/631] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:26.732513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:26.800108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 324/632] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:26.800108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:26.891577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862f858-2a8e-471b-8f3a-082e4fcb8158 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:26.908803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:26.933534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:26.942050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:26.943218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:26.943694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:26.944159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:26.954964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee912072-6234-41b0-af1c-6485709087b4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:26.960197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:26.969075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:26.970332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:26.971409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:26.976071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 309/633] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:26.976071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.016396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.017216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.017496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.017767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/59ec11c9fac7430c927f894959023e36/roles/67bbea02b9dc4cc392c0ac937749dc57` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.037028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=59ec11c9fac7430c927f894959023e36, role_id=67bbea02b9dc4cc392c0ac937749dc57)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:27.038478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:27.053466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 325/634] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:26 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/59ec11c9fac7430c927f894959023e36/roles/67bbea02b9dc4cc392c0ac937749dc57 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:27.054626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.140738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c84af-8da4-4f3f-875f-e498c4bd90ef None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:27.212774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.214849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.215335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.215765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.219839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7444f3-9c2f-4bb7-a729-b1bd8f68eb6f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:27.232668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:27.235047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:27.253714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:27.254987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:27.256125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:27.256125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:27.256125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:27.257629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 310/635] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:27.258651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.259805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:27.272398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8802a0-0238-49c7-83ff-904479bc7452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.273328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8802a0-0238-49c7-83ff-904479bc7452 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.273516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8802a0-0238-49c7-83ff-904479bc7452 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.273788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8802a0-0238-49c7-83ff-904479bc7452 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.289534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8802a0-0238-49c7-83ff-904479bc7452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ab8802a0-0238-49c7-83ff-904479bc7452 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:27.295354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:27.296663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:27.297603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 326/636] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:27.298407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db755-6a7d-46f4-a7fd-621b079353d8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.298407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db755-6a7d-46f4-a7fd-621b079353d8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.298541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0db755-6a7d-46f4-a7fd-621b079353d8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.300637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 327/637] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:27.301434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0db755-6a7d-46f4-a7fd-621b079353d8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.320772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:27.392216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8c7a6-9f70-4a61-8cea-27e28be59df1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:27.434966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.435580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.435865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.436174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.436842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:27.437155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:27.438532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:27.442174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0db755-6a7d-46f4-a7fd-621b079353d8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:27.449359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 311/638] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:27.450213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.492848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586b67b-db7f-4c4c-9b56-6469cbdd81e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.493935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586b67b-db7f-4c4c-9b56-6469cbdd81e9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.494223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586b67b-db7f-4c4c-9b56-6469cbdd81e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.494501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586b67b-db7f-4c4c-9b56-6469cbdd81e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.495133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586b67b-db7f-4c4c-9b56-6469cbdd81e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:27.495438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586b67b-db7f-4c4c-9b56-6469cbdd81e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:27.497887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586b67b-db7f-4c4c-9b56-6469cbdd81e9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:27.511890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 328/639] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:27.513597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5ab0-b613-4f4d-9838-dc01dd66403c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.513887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5ab0-b613-4f4d-9838-dc01dd66403c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.514163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d5ab0-b613-4f4d-9838-dc01dd66403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.533902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d32d5ab0-b613-4f4d-9838-dc01dd66403c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:27.535100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d32d5ab0-b613-4f4d-9838-dc01dd66403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:27.573327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4a833-d7b0-450a-b99e-8cf2b03f5998 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:27.583309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:27.598329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:27.624186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.624806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.625078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.625393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.626065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:27.626363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:27.627737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:27.636397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 329/640] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:27.641231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5ab0-b613-4f4d-9838-dc01dd66403c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.641670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 312/641] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:27.642634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.772815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02924-6a54-4c43-88fd-24e0b3b1459a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:27.777289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d5ab0-b613-4f4d-9838-dc01dd66403c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:27.815926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.816544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.816824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.817147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.825360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:27.826337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:27.826822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:27.827406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:27.827877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:27.828489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:27.839062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:27.840031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:27.840934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:27.842620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:27.844430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:27.844542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 313/642] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:27.845384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:27.863537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:27.864679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:27.865566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:27.865566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:27.865566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:27.867822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 330/643] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:27.869382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:27.882479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:27.912876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:27.973625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3855e22-e0e4-49bb-b8d0-ae14b5cc5f97 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.006738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b75a7a-99d3-41c1-a081-9043d7dc51d6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.029847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.030428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.030796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.031248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.047318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.047936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.048241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.048832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.049199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:28.049506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.050893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.051005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.052362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.074042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 331/644] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:28.074042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:28.074402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:28.075510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:28.076711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:28.076711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:28.076711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:28.076711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 314/645] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:28.076711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.173047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:28.206885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d69ea2-263a-4cb8-9d35-09c5761c5a70 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.214827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:28.226666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62eb6-51ed-4bf7-b8ce-896cd5785eb5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.255534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.257816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.259615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.260221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.273207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:28.278757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:28.279337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:28.281180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:28.282929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:28.283657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.283657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.283657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.283657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:28.283657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.283657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.285776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 315/646] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:28.286485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.297211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 332/647] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:28.302421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.428001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5bcf-f874-48b7-929d-e45dc2f98be4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.429064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45cee1-0569-42ba-93d8-182edea473fe None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.471122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.472199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.472491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.472776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.473723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:28.474093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.475459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.480301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.481332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.481810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.482282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.483522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=3faaacdf2ff54c06bb4eebf13533a72a) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:28.484108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.486962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.504239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 333/648] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:28.504457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 316/649] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/role_assignments?user.id=3faaacdf2ff54c06bb4eebf13533a72a&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:28.504457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.504658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.508952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:28.526056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:28.657993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621333f0-69e2-46c8-8cf3-7b271ea7633b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.705546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.706464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.706996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.707955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.709589 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:28.710180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.712362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.714469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064373fd-1dac-477c-9658-2edf3b7bdfff None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.724205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 334/650] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:28.725405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.787928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.789026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.789487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.790510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.806088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.808939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.831880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:28.837895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:28.839032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 14 12:47:28.840125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:28.840693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 317/651] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:28.843148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:28.889086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da94117-504a-4f14-90df-d851e53aa5b1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:28.936662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:28.938079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:28.938663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:28.939165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:28.949092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:28.950939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:28.964742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:28.968590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:28.969620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:47:28.970591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:28.973873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 335/652] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:28.975088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:29.047421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f303-057a-42cd-be98-52b33ba3eb47 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:29.108976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc806d-72fb-4e80-963e-e6adbfb9be85 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:29.114933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:29.115605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.115978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.116284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.131492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:29.133217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:29.147924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:29.155548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:29.156583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.157083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:29.157497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:29.158446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:29.159393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:29.159393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:29.159393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:29.159998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 318/653] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:29.160303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.161325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:29.161849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:29.162053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:29.163721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:29.193900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 336/654] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Sep 14 12:47:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:29.195389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:29.348559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1b244-cdec-4c25-ac3d-b58bd5552ace None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:29.358636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3929ae-d1f9-4f4f-a1c4-05eee094af57 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:29.375074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:29.410701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3857c-feed-4e68-b9ca-bec012fc1c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:29.412003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3857c-feed-4e68-b9ca-bec012fc1c2d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.412725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3857c-feed-4e68-b9ca-bec012fc1c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.413349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3857c-feed-4e68-b9ca-bec012fc1c2d None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.415006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3857c-feed-4e68-b9ca-bec012fc1c2d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:29.415740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3857c-feed-4e68-b9ca-bec012fc1c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:29.418840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3857c-feed-4e68-b9ca-bec012fc1c2d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:29.419525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:29.420507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.420975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.421434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.422502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:29.423014 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:29.425254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:29.444500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 337/655] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:29.445963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:29.456422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 319/656] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Sep 14 12:47:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:29.458939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568640-3d4a-42ca-bc64-2921061f3dde None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.459637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568640-3d4a-42ca-bc64-2921061f3dde None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.460354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568640-3d4a-42ca-bc64-2921061f3dde None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.462951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 320/657] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:29.464581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568640-3d4a-42ca-bc64-2921061f3dde None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:29.537717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:29.606586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca444393-f98c-4c43-a6fc-adacffb5e308 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:29.655598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568640-3d4a-42ca-bc64-2921061f3dde None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:29.667628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adcdaf-afa0-4e82-a143-c258a4be3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:29.668542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adcdaf-afa0-4e82-a143-c258a4be3224 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.668976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adcdaf-afa0-4e82-a143-c258a4be3224 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.670087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adcdaf-afa0-4e82-a143-c258a4be3224 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.728215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:29.729554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.730189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.731148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.748697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:29.751804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:29.770839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:29.772740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 321/658] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:29.774647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:29.778602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adcdaf-afa0-4e82-a143-c258a4be3224 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:29.780257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adcdaf-afa0-4e82-a143-c258a4be3224 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:29.816181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:29.851201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:29.921149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ed401-9535-443b-a047-e92f4eebd738 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:29.921331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 338/659] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:29.921984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22f3ab-833d-4f12-afd1-e8d199440b37 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.921984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22f3ab-833d-4f12-afd1-e8d199440b37 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.922273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22f3ab-833d-4f12-afd1-e8d199440b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:29.943127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5d22f3ab-833d-4f12-afd1-e8d199440b37 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:29.944386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d22f3ab-833d-4f12-afd1-e8d199440b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:29.962940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:29.963563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:29.963846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:29.964308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:30.037073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 339/660] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:30.037934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22f3ab-833d-4f12-afd1-e8d199440b37 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.064965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:30.068504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:30.111255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:30.132486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:30.154728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22f3ab-833d-4f12-afd1-e8d199440b37 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:30.193268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:30.193811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:30.194506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:30.194619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:30.195307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:30.195616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:30.197370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:30.206901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 322/661] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:30.208272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.217347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 340/662] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:30.218288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.333078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2360e9-6773-4b00-b161-bbfef61b78fd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:30.333897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c59b59-f179-4487-9015-eebbe12025ab None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:30.371095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:30.377648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:30.378302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:30.379021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:30.379297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:30.380857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:30.381594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:30.381832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:30.382103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:30.391135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:30.392736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:30.394657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:30.395802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:30.397375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:30.412427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:30.413476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:30.414553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:30.414553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:30.414553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:30.414553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 323/663] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:30.416147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:30.421436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:30.422783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:30.424802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:30.424802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:30.424802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:30.424802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 341/664] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:30.424802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.561584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47853038-0953-46e8-9fb6-e9f91012e85a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:30.562199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a733a05-d303-4292-8976-3e864d00c9f0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:30.601184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:30.601803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:30.602088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:30.602893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:30.603650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:30.604527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:30.604798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:30.605070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:30.626466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:30.631866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:30.632982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:30.633950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 342/665] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:30.634650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.682435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:30.707602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:30.711954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:30.714536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:30.788525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3467996-34f8-4fa9-8d95-43dafa55d71f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:30.831259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:30.832200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:30.832200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:30.832489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:30.832997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:30.833299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:30.834687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:30.850949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 343/666] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:30.851820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.866464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 324/667] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:30.867750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:30.985931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:30.989700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c736792-e5b7-4740-bbbd-a6b7798b947b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.009331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:31.010427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0c85e-3822-4cbd-ab1e-f3dd1dda1db1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.042671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.043326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.043608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.043884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.044586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:31.044889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.046276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.057260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.058031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.058468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.058751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.059434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:31.059736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.064497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 344/668] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:31.064497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.064751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.079837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 325/669] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:31.079837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.190354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07208b3-3175-4e10-8e61-96a1bc0a0833 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.201996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7158e-e4a7-46f4-9e74-291be1d44a7b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.239919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.240694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.241145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.241428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.241659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.242292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.242549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.242823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.250184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.251705 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.257171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.259254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:31.264921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:31.266049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:31.266945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 345/670] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:31.267455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.270323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:31.279327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:31.280979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:31.281928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:31.281928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:31.281928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:31.283069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 326/671] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:31.284590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.302231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:31.381635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f2d55-c3c4-462d-a706-e87864dca08a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.398520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152626-605e-4c21-b944-240e731d6de8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.419964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291d16b-a713-4458-8982-1e888292134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.420637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d16b-a713-4458-8982-1e888292134c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.420907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d16b-a713-4458-8982-1e888292134c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.421178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291d16b-a713-4458-8982-1e888292134c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.428372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291d16b-a713-4458-8982-1e888292134c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.429819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291d16b-a713-4458-8982-1e888292134c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b291d16b-a713-4458-8982-1e888292134c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:31.443475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:31.444775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:31.445693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 346/672] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:31.446235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1ab6-9efb-4ac8-a3ea-bdded4ac3ea5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.446308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1ab6-9efb-4ac8-a3ea-bdded4ac3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.446787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f1ab6-9efb-4ac8-a3ea-bdded4ac3ea5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.453408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 347/673] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:31.453408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f1ab6-9efb-4ac8-a3ea-bdded4ac3ea5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.453697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.453900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.454132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.454460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.467378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.468869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:31.485443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:31.486655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:31.487784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:31.487784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:31.487784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:31.487784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 327/674] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:31.487784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.546827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:31.561982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:31.574482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f1ab6-9efb-4ac8-a3ea-bdded4ac3ea5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.608257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86841-e099-4b29-a90a-75f187e43534 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.616889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.617506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.617783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.618130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.618880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:31.619181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.620695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.639250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 348/675] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:31.639250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.656194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a524fa-f9d6-4166-a012-c870f3f29fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.656815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a524fa-f9d6-4166-a012-c870f3f29fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.657092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a524fa-f9d6-4166-a012-c870f3f29fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.657366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a524fa-f9d6-4166-a012-c870f3f29fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.658017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a524fa-f9d6-4166-a012-c870f3f29fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:31.658320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a524fa-f9d6-4166-a012-c870f3f29fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.659708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a524fa-f9d6-4166-a012-c870f3f29fa7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.673281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 328/676] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:31.674553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e0fb4-57d1-447f-bbbe-87fcc5375ee5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.674840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e0fb4-57d1-447f-bbbe-87fcc5375ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.675121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e0fb4-57d1-447f-bbbe-87fcc5375ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.694425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d77e0fb4-57d1-447f-bbbe-87fcc5375ee5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:31.695554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d77e0fb4-57d1-447f-bbbe-87fcc5375ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:31.747631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f21bc-cb26-41e3-8de0-22092610452a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.778862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 329/677] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:31.780402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e0fb4-57d1-447f-bbbe-87fcc5375ee5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.784271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.784990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.785371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.785743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.786548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:31.786953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.788515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.809181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 349/678] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:31.809181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.818518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:31.851221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:31.918066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e0fb4-57d1-447f-bbbe-87fcc5375ee5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.928242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c9f9f-0a56-4669-afc9-908ee45c8bf1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:31.955007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.955572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.955886 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.956214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.957022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:31.957360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.958813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.969649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:31.970415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:31.970693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:31.970971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:31.971698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=59b299d3239e4f53912477d94975d9ba) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:31.972025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:31.976898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 330/679] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:31.977056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:31.977149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:31.982635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 350/680] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/role_assignments?user.id=59b299d3239e4f53912477d94975d9ba&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:31.992241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:32.102911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:32.140864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a121-2d8b-4756-825f-bbdd3e224a1d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.147837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:32.152572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7917-88e1-4489-a88e-7e564ae9ad44 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.188522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:32.189576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:32.190071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:32.190526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:32.191499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=05fad60cd02c4c2295beb15783aecfc1) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:32.191993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:32.192131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:32.192750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:32.193035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:32.193303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:32.193990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:32.203229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 351/681] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/role_assignments?user.id=05fad60cd02c4c2295beb15783aecfc1&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:32.203623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:32.206421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:32.208402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:32.236989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:32.238700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:32.239861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:32.246139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 331/682] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:32.246139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:32.407162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373a36d-cff9-4d1c-bcf3-637feebb4f3f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.437618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adbfbf-ffc6-4a9e-8b0e-1517d5522e59 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.488821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:32.490248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:32.490745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:32.491235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:32.503145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:32.505266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:32.506426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:32.507596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:32.508271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:32.508396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:32.508674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:32.526150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:32.526610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:32.528702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:32.530054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 352/683] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:32.533915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:32.537203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:32.539413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:32.541155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 332/684] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:32.545259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:32.578920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:32.670438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc679ba-23b1-44fb-a8e7-45fe1d200d97 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.680383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add3693a-3838-4393-bd19-0fda1bc4da56 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.713515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:32.714199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:32.714472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:32.714754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:32.715501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:32.715810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:32.717671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:32.731021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:32.731921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:32.732389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:32.732809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:32.733650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 353/685] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:32.733874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:32.734368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:32.734611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:32.736454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:32.763438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 333/686] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Sep 14 12:47:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:32.764329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:32.865091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:32.902506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:32.926505 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090b643-d9fb-48e4-944b-d3770f599c67 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.935544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e74721-2675-4977-80b3-4e1d97ea24e6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:32.986073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:32.987509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:32.988106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:32.988878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:32.990255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:32.991506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:32.994539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:33.007083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 354/687] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:33.008373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:33.014445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:33.014445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:33.014719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:33.014993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:33.016355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=f5ca117fa96d412e9bda506591a01fbe) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:33.016978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:33.020792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:33.033515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 334/688] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:32 2022] GET /identity/v3/role_assignments?user.id=f5ca117fa96d412e9bda506591a01fbe&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:33.035055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:33.160668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d1e1b-9812-4ddc-850c-0cb65707ffe7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:33.194291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:33.213420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:33.213420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:33.213420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:33.213887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:33.248331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4505233-398e-4471-9b1a-bcafb8bbd003 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:33.311373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:33.311727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:33.312554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:33.312554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:33.317052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:33.318991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:33.337042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:33.338810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:33.342528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:33.365752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:33.366816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:33.367768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:33.367768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:33.367768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:33.367768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 335/689] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:33.376116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:33.560054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 355/690] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:33.562013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:33.581536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dabd933-773d-45dc-a25f-8d160d26c220 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:33.604201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:33.641606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:33.642479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:33.642660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:33.642925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:33.643532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:33.643986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:33.645285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:33.669279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 336/691] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:33.676364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:33.795731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d6000-9116-4e5f-8ce1-42f9a48b1217 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:33.808764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:33.864792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:33.869907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:33.870399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:33.870832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:33.906516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:33.908254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:33.948414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:33.949826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:33.950727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:33.950727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:33.950727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:33.951555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 356/692] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:33.961021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:33.968617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd91eb-5226-4ba7-b0cb-79295f4c1718 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:34.060120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:34.061032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:34.061485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:34.061904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:34.073139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:34.074878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:34.111839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:34.113183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:34.115867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:34.124065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:34.125953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 337/693] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:47:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:34.132170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:34.152424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39be11-408a-4936-943f-ddab5bdd6ead None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:34.205015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:34.205015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:34.205015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:34.205015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:34.206224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:34.206224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:34.206224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:34.224174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 357/694] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:34.235430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:34.378179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a9c17-727e-49ed-896d-76285c0702a6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:34.427993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8250e09-16b2-4c0c-9fb4-e44082e4fb16 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:34.439289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:34.475571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:34.485714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:34.487166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:34.487846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:34.488537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:34.500846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:34.503913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:34.521354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:34.523042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:34.525191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:34.526589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:34.526589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:34.526589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:34.527525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 358/695] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:34.527764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:34.529059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:34.529598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:34.531064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:34.545312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:34.569956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 338/696] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:47:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:34.576983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:34.782312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfec763-ee98-434e-b943-4330c0900222 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:34.841680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:34.842319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:34.842599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:34.844299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:34.845243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:34.845561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:34.846050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e872c-19d6-41b4-95bf-fe22114946a7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:34.846998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:34.870446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 359/697] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:34.877161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:34.894721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ac176-e8ce-42eb-aa0c-662726749d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:34.895233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac176-e8ce-42eb-aa0c-662726749d13 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:34.895518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac176-e8ce-42eb-aa0c-662726749d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:34.895794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ac176-e8ce-42eb-aa0c-662726749d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:34.960318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:34.990594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:35.023425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e50d44-6fd7-4c4e-8260-3518ecd240a5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:35.062571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:35.063108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:35.063485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:35.063981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:35.065531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=59ec11c9fac7430c927f894959023e36) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:35.067406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:35.068377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:35.077803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ac176-e8ce-42eb-aa0c-662726749d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:35.077995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 360/698] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:34 2022] GET /identity/v3/role_assignments?user.id=59ec11c9fac7430c927f894959023e36&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:35.079721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ac176-e8ce-42eb-aa0c-662726749d13 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:35.288862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 339/699] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:35.296462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:35.382982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5d48-7a21-4a7c-abaf-7452a6e6adbc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:35.383829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5d48-7a21-4a7c-abaf-7452a6e6adbc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:35.384633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac5d48-7a21-4a7c-abaf-7452a6e6adbc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:35.386949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 340/700] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:35.392745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff546-4d58-4cf2-b76e-0aa22fbac237 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:35.393068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff546-4d58-4cf2-b76e-0aa22fbac237 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:35.393296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff546-4d58-4cf2-b76e-0aa22fbac237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:35.436677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3d4ff546-4d58-4cf2-b76e-0aa22fbac237 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:35.438440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3d4ff546-4d58-4cf2-b76e-0aa22fbac237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:35.443143 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e287b-efc9-4b33-91e1-843f62a2d8ec None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:35.463036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:35.489405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fb139-47e1-4d27-b027-a211dd83dfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:35.490092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb139-47e1-4d27-b027-a211dd83dfec None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:35.490367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb139-47e1-4d27-b027-a211dd83dfec None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:35.490639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fb139-47e1-4d27-b027-a211dd83dfec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:35.526094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fb139-47e1-4d27-b027-a211dd83dfec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:35.528051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22fb139-47e1-4d27-b027-a211dd83dfec None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e22fb139-47e1-4d27-b027-a211dd83dfec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:35.552137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:35.554483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:35.557538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:35.557538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:35.557538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:35.557538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 361/701] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:35.557538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dab2a-429c-4677-9658-8e90941ccd64 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:35.557538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dab2a-429c-4677-9658-8e90941ccd64 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:35.557538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dab2a-429c-4677-9658-8e90941ccd64 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:35.559951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 362/702] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:35.565648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dab2a-429c-4677-9658-8e90941ccd64 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:35.572242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 341/703] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:35.572242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70ee7-f063-4b4a-9904-401fb24a1a16 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:35.572242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70ee7-f063-4b4a-9904-401fb24a1a16 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:35.572242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee70ee7-f063-4b4a-9904-401fb24a1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:35.579926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:35.597376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7ee70ee7-f063-4b4a-9904-401fb24a1a16 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:35.599145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7ee70ee7-f063-4b4a-9904-401fb24a1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:35.747684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dab2a-429c-4677-9658-8e90941ccd64 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:35.807471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:35.808470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:35.809435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:35.810200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:35.811273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:35.811824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:35.814460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:35.821524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 342/704] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:35.841595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 363/705] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:35.848112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee70ee7-f063-4b4a-9904-401fb24a1a16 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:35.969742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.018322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee70ee7-f063-4b4a-9904-401fb24a1a16 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.039050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:36.084859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:36.092038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.092696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.092977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.093251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.103083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.107063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:36.130364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:36.131387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:36.132328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:36.138918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 343/706] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:36.149633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.190424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be718b6f-bb69-4b3d-9bf6-e20ef4c029c6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.248880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.249527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.250034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.250034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.267191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.269228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:36.290793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:36.291928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:36.292861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:36.292861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:36.292861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:36.295251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 364/707] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:36.296473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.331712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cc38a-a29f-4d80-aab8-1ff9825b007d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.373218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.373840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.374112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.374438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.375202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:36.375507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.377299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.398820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 344/708] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:36.398820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.430323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:36.457214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc74e17-944a-4246-8795-08fcd2ba4944 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.469273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:36.503887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a886e-e484-4586-b527-6f079e040728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.505029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a886e-e484-4586-b527-6f079e040728 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.505521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a886e-e484-4586-b527-6f079e040728 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.506077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a886e-e484-4586-b527-6f079e040728 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.507004 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a886e-e484-4586-b527-6f079e040728 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.508841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a886e-e484-4586-b527-6f079e040728 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-587a886e-e484-4586-b527-6f079e040728 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:36.522422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:36.523501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:36.524769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:36.528694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 365/709] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Sep 14 12:47:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:36.529064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150ebe-34cc-47d4-a488-7f6117d96df3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.529980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a886e-e484-4586-b527-6f079e040728 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.586367 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.588042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.588563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.589075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.590116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:36.590644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.592382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.607356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 345/710] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:36.608735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.675313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a886e-e484-4586-b527-6f079e040728 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.717034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.717550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.717833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.718102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.719471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=3faaacdf2ff54c06bb4eebf13533a72a) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:36.719471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.721406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.736059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 366/711] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:36 2022] GET /identity/v3/role_assignments?user.id=3faaacdf2ff54c06bb4eebf13533a72a&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:36.736059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.742940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:36.815243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5b2cb-474c-44dd-a850-42144b92e766 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.835447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:36.867632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaf624-1313-4e87-9072-6ba2809dfd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.869670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf624-1313-4e87-9072-6ba2809dfd01 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.869670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf624-1313-4e87-9072-6ba2809dfd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.869851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaf624-1313-4e87-9072-6ba2809dfd01 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.876046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaf624-1313-4e87-9072-6ba2809dfd01 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:36.876046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaf624-1313-4e87-9072-6ba2809dfd01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.876046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaf624-1313-4e87-9072-6ba2809dfd01 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.884969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 346/712] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Sep 14 12:47:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:36.886733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5c079-4d83-4789-8939-7230630072d7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.887205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5c079-4d83-4789-8939-7230630072d7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.887661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5c079-4d83-4789-8939-7230630072d7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.896313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 347/713] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:36.897896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5c079-4d83-4789-8939-7230630072d7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:36.915448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08bfcb-aece-4748-a34e-22824c859201 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:36.964759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf40a5f3-46ea-44f3-8466-c5c75d87ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:36.965389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40a5f3-46ea-44f3-8466-c5c75d87ea8d None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.965677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40a5f3-46ea-44f3-8466-c5c75d87ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.965933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf40a5f3-46ea-44f3-8466-c5c75d87ea8d None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:36.966593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40a5f3-46ea-44f3-8466-c5c75d87ea8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:36.968070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf40a5f3-46ea-44f3-8466-c5c75d87ea8d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:36.996091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 367/714] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:47:36 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:36.997626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8053-630b-4d36-96ab-6f27b354cfc1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:36.997900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8053-630b-4d36-96ab-6f27b354cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:36.998173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd8053-630b-4d36-96ab-6f27b354cfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:37.019052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9cdd8053-630b-4d36-96ab-6f27b354cfc1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:37.020585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9cdd8053-630b-4d36-96ab-6f27b354cfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:37.114564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5c079-4d83-4789-8939-7230630072d7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:37.136187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:37.163193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 368/715] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:37.202711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:37.203459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:37.203735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:37.204039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:37.204795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:37.205355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:37.206950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:37.218077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 348/716] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Sep 14 12:47:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:37.506557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd8053-630b-4d36-96ab-6f27b354cfc1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:37.658250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd8053-630b-4d36-96ab-6f27b354cfc1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:37.710136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:37.710779 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:37.711060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:37.711329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:37.712727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:37.714282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:37.730339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:37.731408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:37.733485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 369/717] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:37 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:37.737342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:37.853956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:37.988459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724861e-f22f-4491-8244-a65d4ea0b100 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:38.049142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f615a-7dfc-43de-95f2-11e75393f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:38.050349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f615a-7dfc-43de-95f2-11e75393f977 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:38.050930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f615a-7dfc-43de-95f2-11e75393f977 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:38.051487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f615a-7dfc-43de-95f2-11e75393f977 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:38.052464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f615a-7dfc-43de-95f2-11e75393f977 None admin] RBAC: Adding query filter params (name=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:38.052979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f615a-7dfc-43de-95f2-11e75393f977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:38.054814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f615a-7dfc-43de-95f2-11e75393f977 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:38.062474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 349/718] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:47:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:38.067648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:38.153131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:38.213599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f71b5f-cadf-4f46-9b40-a9ac97719d21 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:38.293131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688acf12-4cdb-4c97-95c5-5cfbaf0bf167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:38.294311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acf12-4cdb-4c97-95c5-5cfbaf0bf167 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:38.294799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acf12-4cdb-4c97-95c5-5cfbaf0bf167 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:38.295284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688acf12-4cdb-4c97-95c5-5cfbaf0bf167 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:38.296501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688acf12-4cdb-4c97-95c5-5cfbaf0bf167 None admin] RBAC: Adding query filter params (type=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:38.297058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688acf12-4cdb-4c97-95c5-5cfbaf0bf167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:38.299723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688acf12-4cdb-4c97-95c5-5cfbaf0bf167 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:38.311908 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 370/719] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:47:38 2022] GET /identity/v3/services?type=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:38.354266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacd40-6270-4442-8e53-13660438af10 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:38.354536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacd40-6270-4442-8e53-13660438af10 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:38.354908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaacd40-6270-4442-8e53-13660438af10 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:38.356205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 350/720] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:38.363299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d966-5387-4344-ae2b-ae284da5f8d1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:38.363657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d966-5387-4344-ae2b-ae284da5f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:38.363939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5d966-5387-4344-ae2b-ae284da5f8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:38.386268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a4e5d966-5387-4344-ae2b-ae284da5f8d1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:38.387517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4e5d966-5387-4344-ae2b-ae284da5f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:38.492320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 371/721] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:38.803731 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaacd40-6270-4442-8e53-13660438af10 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:38.947460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaacd40-6270-4442-8e53-13660438af10 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:38.953123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:39.001747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:39.002386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:39.002667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:39.002937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:39.018710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:39.023632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:39.025579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:39.026451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 351/722] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:39.031738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d966-5387-4344-ae2b-ae284da5f8d1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:39.105717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:39.179520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5d966-5387-4344-ae2b-ae284da5f8d1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:39.240972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:39.241586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:39.241863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:39.242129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:39.243334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:39.243633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:39.245018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:39.260754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 372/723] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:39.266940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:39.447001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05f783-3274-44da-b39d-cca0431e90c3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:39.505376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7f413-319c-4a18-b785-c498e2e09a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:39.506014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f413-319c-4a18-b785-c498e2e09a6e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:39.506291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f413-319c-4a18-b785-c498e2e09a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:39.506559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f413-319c-4a18-b785-c498e2e09a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:39.519505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7f413-319c-4a18-b785-c498e2e09a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:39.521131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7f413-319c-4a18-b785-c498e2e09a6e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-09e7f413-319c-4a18-b785-c498e2e09a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:39.540991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:39.542879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:39.544621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:39.544621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:39.544621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:39.544621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 352/724] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:39.553167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:39.734650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35a90e-1a7e-47ba-8453-495db425ac14 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:39.756050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:39.772977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f11c0-3881-4aff-a653-8c3b7926b6b2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:39.773615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f11c0-3881-4aff-a653-8c3b7926b6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:39.774624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f11c0-3881-4aff-a653-8c3b7926b6b2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:39.777718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 353/725] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:39.783457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b367-e52f-469a-ba8b-22fca227b38f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:39.783771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b367-e52f-469a-ba8b-22fca227b38f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:39.784368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c580b367-e52f-469a-ba8b-22fca227b38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:39.798170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:39.798798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:39.799081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:39.799359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:39.800044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:39.800350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:39.801734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:39.806589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c580b367-e52f-469a-ba8b-22fca227b38f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:39.808074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c580b367-e52f-469a-ba8b-22fca227b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:39.820758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:39.829380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 373/726] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:39.835362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:39.893514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 354/727] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:40.025757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb065a7-1635-4532-aa28-c2b5358ff5d5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:40.082759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05843d69-4a81-4c16-a344-ad071ba86c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:40.083419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843d69-4a81-4c16-a344-ad071ba86c6e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.083700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843d69-4a81-4c16-a344-ad071ba86c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.083974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05843d69-4a81-4c16-a344-ad071ba86c6e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.097042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05843d69-4a81-4c16-a344-ad071ba86c6e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:40.098518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05843d69-4a81-4c16-a344-ad071ba86c6e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:40.113425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7b70-9faa-4603-8fac-e62da97cd8e4 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.113951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7b70-9faa-4603-8fac-e62da97cd8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.114079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7b70-9faa-4603-8fac-e62da97cd8e4 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.116131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 355/728] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-05843d69-4a81-4c16-a344-ad071ba86c6e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:40.117955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:40.120088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:40.121756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 374/729] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:40.126527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7b70-9faa-4603-8fac-e62da97cd8e4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:40.126850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc428f-584e-402c-8ec9-b78d275c2275 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.127076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc428f-584e-402c-8ec9-b78d275c2275 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.127294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc428f-584e-402c-8ec9-b78d275c2275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.163863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f2fc428f-584e-402c-8ec9-b78d275c2275 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:40.165924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f2fc428f-584e-402c-8ec9-b78d275c2275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:40.203192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:40.289296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 375/730] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:47:40.312174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169139-bf4a-4770-ad02-9af2fcf44d91 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.312689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169139-bf4a-4770-ad02-9af2fcf44d91 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.313108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169139-bf4a-4770-ad02-9af2fcf44d91 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.314991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 376/731] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:40.320376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0c1d7-d9a4-4058-a06a-20b2f381d964 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.321458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0c1d7-d9a4-4058-a06a-20b2f381d964 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.322067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0c1d7-d9a4-4058-a06a-20b2f381d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.354088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4ff0c1d7-d9a4-4058-a06a-20b2f381d964 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:40.355285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ff0c1d7-d9a4-4058-a06a-20b2f381d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:40.355398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7b70-9faa-4603-8fac-e62da97cd8e4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:40.395615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:40.396294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.396559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.396835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.397567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:40.397874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:40.400029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:40.429551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 356/732] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Sep 14 12:47:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:40.431002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:40.435354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:40.442512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 377/733] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 14 12:47:40.443620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0c1d7-d9a4-4058-a06a-20b2f381d964 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:40.595853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:40.605474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0c1d7-d9a4-4058-a06a-20b2f381d964 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:40.609360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774cbdd1-2d5e-4baf-b2ff-45fdef71c7b3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:40.649037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:40.650065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.650623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.651265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.653167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:40.653810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.654088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.654359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.667208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:40.672479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:40.674057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:40.675500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:40.678767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 357/734] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:40.679663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:40.750828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:40.752720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:40.789066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:40.839251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b7d10-8157-4e42-8bba-194a2e519441 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:40.894207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:40.895203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:40.895672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:40.896172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:40.902639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:40.912827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:40.915896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 378/735] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 14 12:47:40.917674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:40.922249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:40.924146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:40.925926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 358/736] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:40.928911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.046724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52531c4-8e82-4f17-9d76-fbd9aee7fc4e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.047182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5077b9-cb1e-4494-a88a-2335789ad876 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.074728 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:41.086128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.087581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.087859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.087963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.088172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.088575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.088852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:41.088964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.089141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.089235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.089797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.090557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.091204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.106610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 379/737] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:41.106610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.114508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 359/738] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:47:40 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:41.125162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.179156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:41.237945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4b412-16ac-4e52-9580-b03756af9e2a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.284913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875764a5-2931-4795-bcae-724306bef8cd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.290560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.291274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.291554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.291828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.303180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.304786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:41.322644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:41.323714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:41.324758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:41.324758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:41.324758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:41.324758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 380/739] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:41.324758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.328925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282a5a4-2557-4a47-946f-d14c907d4e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.329546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282a5a4-2557-4a47-946f-d14c907d4e10 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.329871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282a5a4-2557-4a47-946f-d14c907d4e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.330095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282a5a4-2557-4a47-946f-d14c907d4e10 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.330773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282a5a4-2557-4a47-946f-d14c907d4e10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:41.331072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282a5a4-2557-4a47-946f-d14c907d4e10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.332517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282a5a4-2557-4a47-946f-d14c907d4e10 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.343340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 360/740] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:41.344857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71fa34-7c3c-4d16-970e-23c240d6d9dc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.344857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71fa34-7c3c-4d16-970e-23c240d6d9dc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.345046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71fa34-7c3c-4d16-970e-23c240d6d9dc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.346255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 361/741] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:41.346961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71fa34-7c3c-4d16-970e-23c240d6d9dc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.398273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:41.447548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc9cdd-9cd1-453b-a31a-60c15b14fbd9 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.450762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:41.466131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71fa34-7c3c-4d16-970e-23c240d6d9dc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.493172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820447bd-abdd-4b93-9d25-57d3c2510f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.493997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820447bd-abdd-4b93-9d25-57d3c2510f6c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.494276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820447bd-abdd-4b93-9d25-57d3c2510f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.494547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820447bd-abdd-4b93-9d25-57d3c2510f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.504170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.505137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.505612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.506057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.506550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820447bd-abdd-4b93-9d25-57d3c2510f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.507061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:41.507551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.508027 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820447bd-abdd-4b93-9d25-57d3c2510f6c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.509397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.522909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 362/742] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:41.524719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-820447bd-abdd-4b93-9d25-57d3c2510f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:41.525702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:41.526895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:41.527782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:41.527782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:41.527782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:41.531763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 381/743] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:41.533514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c02c-a1b0-407a-a737-57f5c3f2c122 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.533803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c02c-a1b0-407a-a737-57f5c3f2c122 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.534076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3c02c-a1b0-407a-a737-57f5c3f2c122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.554522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5ea3c02c-a1b0-407a-a737-57f5c3f2c122 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:41.555903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ea3c02c-a1b0-407a-a737-57f5c3f2c122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:41.636403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 382/744] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:41 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 14 12:47:41.645129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c02c-a1b0-407a-a737-57f5c3f2c122 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.647191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91e6d-74df-42b3-a631-9c98cf5deebe None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.648202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:41.692352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.693164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.693453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.693729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.707475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.709175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:41.730720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:41.731786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:41.732758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:41.732758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:41.732758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:41.736690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 363/745] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:41.737667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.780334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:41.798545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3c02c-a1b0-407a-a737-57f5c3f2c122 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.839961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.841728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.841728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.842072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.855443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.858445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:41.872485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:41.873465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:41.874452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:41.878462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 383/746] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:41.879374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.883586 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73823511-745d-4d54-881b-afd33d1d6242 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:41.931058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:41.931675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:41.931948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:41.932248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:41.933517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:41.933823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:41.935602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:41.949342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 364/747] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:41.949658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:41.967499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:42.024843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc90c3-840c-49e2-9356-60794cf0d2c0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.075174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.075842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.076152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.076424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.077087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:42.077399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.078789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.082216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0b5f9-dfc5-4c57-88ef-fee4c7c1caeb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.092934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 384/748] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:42.094664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.105831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:42.135722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.136451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.136724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.136996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.137684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:42.137985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.139417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.152663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 365/749] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:42.153406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.214826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a795745-f988-409f-9081-96fc86208d7b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.234063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:42.263773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64ea33-34f6-4f7c-9dbb-30d8c446056a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.303620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.304304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.304584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.304859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.315481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.317038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:42.330636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:42.332346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:42.333327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:42.338300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 366/750] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:47:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:42.338300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.374281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.374894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.375434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.375729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.377357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.378755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.396554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 385/751] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:47:42 2022] POST /identity/v3/services => generated 240 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:42.397398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.474761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81279774-ea9f-469f-8001-69cd39b40a3b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.497366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:42.523848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:42.531100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.532175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.532664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.533187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.543495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.545363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.554413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80872f-0da9-415a-bf7d-27e6f488d540 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:42.560560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:42.561611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:47:42.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:42.570281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 367/752] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:47:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:42.571797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.604974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.605830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.606122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.606318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.607112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=59ec11c9fac7430c927f894959023e36) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:42.607508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.609143 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.616890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 386/753] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:42 2022] GET /identity/v3/role_assignments?user.id=59ec11c9fac7430c927f894959023e36&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:42.619387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.734035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d25a19-ce76-472d-a540-39faa1dbb958 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.787794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d158c-9c90-41ae-ad43-7c65f5f5a7a0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:42.809549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.810578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.811061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.811531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.812530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:42.813137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.815890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.854836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 368/754] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:47:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:42.857830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:42.858742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.868993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:42.870290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:42.870627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:42.870904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:42.871686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:42.872668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:42.874182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:42.902898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 387/755] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Sep 14 12:47:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:42.909519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:42.952106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:43.048780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd480860-78a0-456e-bab1-1e483347fd12 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:43.089425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:43.090067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.090346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.090618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.099049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478c052-2be7-46e8-9d4d-0085e5a9b1d7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:43.102083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:43.103539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:43.128080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:43.129988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:43.131755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:43.131755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:43.131755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:43.131755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 369/756] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:43.131755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:43.174900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:43.176638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.177473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.178251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.240209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:43.244590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c439db1-9dd0-4cfc-b4b2-fb19949d1d07 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:43.258773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:43.275623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:43.277751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:43.283930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:43.284610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.284890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.285164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.285815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:43.286122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:43.287536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:43.302015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 370/757] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:43.308447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:43.396188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 388/758] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:47:43.413782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:43.430543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112db12-2f06-4f2b-8751-cfed4ed2a622 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:43.468947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:43.469590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.469872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.470143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.480204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:43.481847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:43.504408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:43.505485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:43.506375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:43.514254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 371/759] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:43.517351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:43.573414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:43.613935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:43.641076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de1bbe-60c2-4908-b5f3-125104839439 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:43.697268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40469b2c-afbb-43fb-93bc-0b4550cef99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:43.697938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469b2c-afbb-43fb-93bc-0b4550cef99f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.698476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469b2c-afbb-43fb-93bc-0b4550cef99f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.698756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469b2c-afbb-43fb-93bc-0b4550cef99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.710044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8212b23-54b9-439b-8db4-0822bad3924d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:43.712137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40469b2c-afbb-43fb-93bc-0b4550cef99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:43.713890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40469b2c-afbb-43fb-93bc-0b4550cef99f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-40469b2c-afbb-43fb-93bc-0b4550cef99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:43.732160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:43.733165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:43.734493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:43.734493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:43.734493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:43.734493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 389/760] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:43.734893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896fe7-75f7-43da-99f0-1886ac63c871 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.736089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896fe7-75f7-43da-99f0-1886ac63c871 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.736089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b896fe7-75f7-43da-99f0-1886ac63c871 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.737014 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 390/761] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:43.740527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b896fe7-75f7-43da-99f0-1886ac63c871 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:43.756633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8a093-90c1-4ad9-8c37-5b6fd11800d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:43.757246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8a093-90c1-4ad9-8c37-5b6fd11800d9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.757525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8a093-90c1-4ad9-8c37-5b6fd11800d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.757795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8a093-90c1-4ad9-8c37-5b6fd11800d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.759396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8a093-90c1-4ad9-8c37-5b6fd11800d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:43.759767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8a093-90c1-4ad9-8c37-5b6fd11800d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:43.762497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8a093-90c1-4ad9-8c37-5b6fd11800d9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:43.790513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 372/762] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:43.791947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8152c9-1ec2-4e7d-a52d-eebb7cd38ddd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.792258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8152c9-1ec2-4e7d-a52d-eebb7cd38ddd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.792534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8152c9-1ec2-4e7d-a52d-eebb7cd38ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.812500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6c8152c9-1ec2-4e7d-a52d-eebb7cd38ddd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:43.813746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6c8152c9-1ec2-4e7d-a52d-eebb7cd38ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:43.874792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b896fe7-75f7-43da-99f0-1886ac63c871 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:43.902532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 373/763] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:43.903516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8152c9-1ec2-4e7d-a52d-eebb7cd38ddd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:43.930871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:43.931485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:43.931759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:43.932041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:43.932740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:43.933046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:43.934304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:43.935004 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:43.955807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:43.967754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 391/764] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:43.969539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:44.110139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178bcd5-744a-48e4-ab4e-0da068afb975 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:44.141514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8152c9-1ec2-4e7d-a52d-eebb7cd38ddd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:44.158841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:44.159481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:44.159754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:44.160036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:44.170820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:44.172297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:44.191382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:44.192390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 392/765] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:44.193667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:44.206682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:44.207674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:44.208237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:44.208612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/3faaacdf2ff54c06bb4eebf13533a72a/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:44.210699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=3faaacdf2ff54c06bb4eebf13533a72a, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:44.212624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:44.233444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 374/766] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:43 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/3faaacdf2ff54c06bb4eebf13533a72a/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:44.233444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:44.317212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:44.407418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:44.415719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb7289-5bf2-4529-bb5d-4ca199de4129 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:44.453015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc91b6-51b0-4753-ad91-a04b5590c20c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:44.500089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:44.500787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:44.501034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:44.501338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:44.501905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:44.503275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:44.507214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:44.508464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:44.509036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:44.509511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:44.510431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:44.510941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:44.512697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:44.514367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:44.515355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:44.516259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 393/767] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Sep 14 12:47:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:44.522287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:44.533508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 375/768] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:44.542811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:44.710102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697821-9fce-40e0-b05f-68eb423f6c5e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:44.736560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:44.751928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:44.752580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:44.752852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:44.753119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:44.753902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:44.754207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:44.755713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:44.761480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 394/769] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Sep 14 12:47:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:44.767257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:44.772223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ca973-7cde-4405-bfe5-e93376f35431 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:44.828790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:44.837578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:44.838208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:44.838489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:44.838763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:44.839501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=c363f0babd8d4180bd4f0dd67bb6b892) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:44.839810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:44.841316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:44.857425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 376/770] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:44 2022] GET /identity/v3/role_assignments?user.id=c363f0babd8d4180bd4f0dd67bb6b892&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:44.933121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13072ce-7f0e-427c-b7ef-7143ca326b1f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:44.993018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038d9cf-50a6-4ab0-8e88-66d1ae181817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:44.993564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d9cf-50a6-4ab0-8e88-66d1ae181817 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:44.993836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d9cf-50a6-4ab0-8e88-66d1ae181817 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:44.994100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038d9cf-50a6-4ab0-8e88-66d1ae181817 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:44.994735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038d9cf-50a6-4ab0-8e88-66d1ae181817 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:44.995033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038d9cf-50a6-4ab0-8e88-66d1ae181817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:44.996409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038d9cf-50a6-4ab0-8e88-66d1ae181817 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:45.001985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 395/771] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Sep 14 12:47:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:45.007862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:45.044281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fcf69-f8f3-4409-8408-77db18fd8d46 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.044640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fcf69-f8f3-4409-8408-77db18fd8d46 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.044826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fcf69-f8f3-4409-8408-77db18fd8d46 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.046422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 396/772] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:45.056687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c5c1-04fb-4b16-af69-9b045001e527 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.057001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c5c1-04fb-4b16-af69-9b045001e527 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.057226 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706c5c1-04fb-4b16-af69-9b045001e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.088735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e706c5c1-04fb-4b16-af69-9b045001e527 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:45.089943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e706c5c1-04fb-4b16-af69-9b045001e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:45.185436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:45.193652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb8926-17dc-4174-a199-d47ca9394f94 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:45.213215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 397/773] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:45.233026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7167afd-706e-46ff-8ce0-65538b87d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:45.233644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167afd-706e-46ff-8ce0-65538b87d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.233920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167afd-706e-46ff-8ce0-65538b87d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.234191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167afd-706e-46ff-8ce0-65538b87d1a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.234887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167afd-706e-46ff-8ce0-65538b87d1a8 None admin] RBAC: Adding query filter params (interface=public, service_id=890cf27a01f149679fd41aad08113180, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:45.235194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167afd-706e-46ff-8ce0-65538b87d1a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:45.236591 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167afd-706e-46ff-8ce0-65538b87d1a8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:45.245289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 377/774] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:47:45 2022] GET /identity/v3/endpoints?service_id=890cf27a01f149679fd41aad08113180&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:45.250528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706c5c1-04fb-4b16-af69-9b045001e527 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:45.363815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706c5c1-04fb-4b16-af69-9b045001e527 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:45.400131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:45.400743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.401017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.401287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.402155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:45.403515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:45.405880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5212-b38e-4c12-83ab-d64c970808f8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.406169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5212-b38e-4c12-83ab-d64c970808f8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.406448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b5212-b38e-4c12-83ab-d64c970808f8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.408063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 378/775] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:45.409839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 398/776] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:47:45 2022] GET /identity/v3/services => generated 772 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:45.413774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e82be-be0e-47f5-8a42-32aa3b41335b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.414073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e82be-be0e-47f5-8a42-32aa3b41335b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.415040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e82be-be0e-47f5-8a42-32aa3b41335b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.435878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d28e82be-be0e-47f5-8a42-32aa3b41335b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:45.437213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d28e82be-be0e-47f5-8a42-32aa3b41335b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:45.515542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:45.538506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 379/777] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:45.590453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:45.646391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:45.707506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c8e99-a5c6-4d85-97c9-bd1cbc971dc3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:45.746267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:45.746929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.747381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.747652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.748306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:45.749775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:45.760803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:45.761881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:45.762733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:45.764215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 399/778] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:45 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:45.770353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e82be-be0e-47f5-8a42-32aa3b41335b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:45.931341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e82be-be0e-47f5-8a42-32aa3b41335b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:45.968232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:45.968938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:45.969218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:45.969488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:45.970172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:45.970503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:45.972078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:45.973373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:45.993822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 380/779] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:47:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:45.996030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:46.092893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:46.143442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5a340-1288-4f33-8335-f81b73d190f6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:46.175424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1f276-6671-4702-8e23-ca7fd96e22a4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:46.191076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:46.191689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.192137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.192416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.193048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] RBAC: Adding query filter params (type=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:46.193348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:46.197325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:46.201244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:46.206733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 381/780] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:47:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:46.217051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:46.250107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:46.252139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.252851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.254757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.280321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:46.287943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:46.288941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:46.290712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:46.293449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 400/781] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:46.304124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:46.441057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b267b0-d6ec-4722-b769-de42ae792fbb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:46.488392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:46.521680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:46.522301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.522582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.522852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.524104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] RBAC: Adding query filter params (interface=public, service_id=7766ff98cc5f4e2993f446454b1914ba, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:46.524478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:46.525960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:46.535111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d3998-c0e1-49a0-a7f2-527ed2bbedef None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:46.547576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 382/782] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:47:46 2022] GET /identity/v3/endpoints?service_id=7766ff98cc5f4e2993f446454b1914ba&interface=public®ion_id=RegionOne => generated 194 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:46.548512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:46.593762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:46.594760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.595239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.600428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.601219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:46.601538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:46.603742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:46.618703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 401/783] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:46.634804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:46.687543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d8515-b2a2-4869-b88a-5cbda3841dde None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:46.702539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:46.765833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a27f4e-1043-4890-85fa-0104464f2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:46.766451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27f4e-1043-4890-85fa-0104464f2862 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.766728 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27f4e-1043-4890-85fa-0104464f2862 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.767000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a27f4e-1043-4890-85fa-0104464f2862 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.767609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a27f4e-1043-4890-85fa-0104464f2862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:46.769011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a27f4e-1043-4890-85fa-0104464f2862 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:46.780568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 383/784] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:47:46 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:46.831200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357392c-ac67-451b-9617-a9ee26f2dd60 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:46.888061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318084-63a6-4611-a713-7f96e56a9499 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.888706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318084-63a6-4611-a713-7f96e56a9499 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.889371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318084-63a6-4611-a713-7f96e56a9499 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.890504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:46.891229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.891409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.891765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.891965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 384/785] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:46.897628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d76ee-7cd9-412a-a7dc-60bb73755cf5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:46.898261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d76ee-7cd9-412a-a7dc-60bb73755cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:46.899462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d76ee-7cd9-412a-a7dc-60bb73755cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:46.912433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:46.914359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:46.943883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-985d76ee-7cd9-412a-a7dc-60bb73755cf5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:46.946090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-985d76ee-7cd9-412a-a7dc-60bb73755cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:46.953843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:46.954836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:46.955745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:46.955745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:46.955745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:46.957696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 402/786] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:46.965369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:47.024628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:47.060627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 385/787] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:47:47.095714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:47.113796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b9a8a-f362-4ceb-afa3-e231b0ede1af None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:47.150123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:47.150749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.151031 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.151306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.152232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:47.152538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:47.153904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:47.166696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 403/788] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:47.172418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d76ee-7cd9-412a-a7dc-60bb73755cf5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:47.287209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d76ee-7cd9-412a-a7dc-60bb73755cf5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:47.331635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:47.332315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.332596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.332871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.344416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:47.345947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:47.364667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:47.365668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:47.366635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 386/789] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:47.373676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:47.384729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:47.440631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:47.553826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e7a4e-a72d-4494-9ef7-d6c044b48871 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:47.583548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8aab67-7cd9-44b3-8f1f-370cd644f66d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:47.613724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:47.614595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.615119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.615527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.616456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:47.616915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:47.624043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:47.641042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:47.641714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.641995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.642257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.659227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 404/790] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Sep 14 12:47:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:47.665558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:47.668624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:47.675005 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:47.692041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:47.693062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:47.693898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:47.704340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 387/791] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:47.705293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:47.835066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d767783-81fb-483f-83b6-98664458fd9a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:47.851216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:47.860266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b1cc3-49e0-4a87-970c-6fe4a92ca12f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:47.881712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f19d9-3e61-46de-a7e0-76626facf0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:47.882353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f19d9-3e61-46de-a7e0-76626facf0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.882629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f19d9-3e61-46de-a7e0-76626facf0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.883488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f19d9-3e61-46de-a7e0-76626facf0e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.901228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f19d9-3e61-46de-a7e0-76626facf0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:47.903528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f19d9-3e61-46de-a7e0-76626facf0e2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:47.907299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177bc57-346c-46a6-bf34-3c0ef1d45b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:47.907986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177bc57-346c-46a6-bf34-3c0ef1d45b18 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.908369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177bc57-346c-46a6-bf34-3c0ef1d45b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.908716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177bc57-346c-46a6-bf34-3c0ef1d45b18 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.909452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177bc57-346c-46a6-bf34-3c0ef1d45b18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:47.909826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177bc57-346c-46a6-bf34-3c0ef1d45b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:47.911817 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177bc57-346c-46a6-bf34-3c0ef1d45b18 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-585f19d9-3e61-46de-a7e0-76626facf0e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:47.920101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:47.921198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:47.923456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:47.923456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:47.923456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:47.923456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 405/792] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:47.923456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85dc6-9c2a-420f-ae77-4bd6b223bf64 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.923456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85dc6-9c2a-420f-ae77-4bd6b223bf64 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.923456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85dc6-9c2a-420f-ae77-4bd6b223bf64 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.925523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 406/793] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:47.926682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85dc6-9c2a-420f-ae77-4bd6b223bf64 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:47.930544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 388/794] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:47.931823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86211b38-d18b-42a2-bcd3-c989f1860a84 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:47.932136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86211b38-d18b-42a2-bcd3-c989f1860a84 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:47.932414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86211b38-d18b-42a2-bcd3-c989f1860a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:47.952151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-86211b38-d18b-42a2-bcd3-c989f1860a84 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:47.953366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-86211b38-d18b-42a2-bcd3-c989f1860a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:48.015814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:48.038283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 389/795] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:48.039349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86211b38-d18b-42a2-bcd3-c989f1860a84 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.085038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce85dc6-9c2a-420f-ae77-4bd6b223bf64 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.126436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.126952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.127210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.127470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.128159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:48.132041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.132041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.145362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 407/796] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:48.152315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.199788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:48.219027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86211b38-d18b-42a2-bcd3-c989f1860a84 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.277423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24244a-93be-4f75-945f-79978b25a427 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.294789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:48.317979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfa592-7ca4-41eb-9eb9-76e244cd2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.318638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa592-7ca4-41eb-9eb9-76e244cd2d55 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.318915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa592-7ca4-41eb-9eb9-76e244cd2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.319191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfa592-7ca4-41eb-9eb9-76e244cd2d55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.327829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfa592-7ca4-41eb-9eb9-76e244cd2d55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.329344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bfa592-7ca4-41eb-9eb9-76e244cd2d55 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-41bfa592-7ca4-41eb-9eb9-76e244cd2d55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:48.342706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:48.343726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:48.344711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:48.348434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 408/797] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:48.349828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004bd3-c1a4-49e6-b281-876634046b6a None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.350113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004bd3-c1a4-49e6-b281-876634046b6a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.350388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0004bd3-c1a4-49e6-b281-876634046b6a None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.352611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 409/798] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:48.353735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004bd3-c1a4-49e6-b281-876634046b6a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.390405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.390798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.391104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.391376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.402578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.404095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:48.420284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:48.423026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:48.425976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:48.425976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:48.425976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:48.426427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 390/799] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:48.427189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.471789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0004bd3-c1a4-49e6-b281-876634046b6a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.511218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1a0f3-0b11-4aa2-b91a-94d392aa1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.511847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1a0f3-0b11-4aa2-b91a-94d392aa1236 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.512164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1a0f3-0b11-4aa2-b91a-94d392aa1236 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.512437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1a0f3-0b11-4aa2-b91a-94d392aa1236 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.523261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1a0f3-0b11-4aa2-b91a-94d392aa1236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c0b1a0f3-0b11-4aa2-b91a-94d392aa1236 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:48.528607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:48.529778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:48.530836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 410/800] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:48.531582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cb713-41ab-4efb-b298-f02080272d36 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.531582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cb713-41ab-4efb-b298-f02080272d36 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.531720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cb713-41ab-4efb-b298-f02080272d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.540839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d684898-3496-4214-83ce-fc130063ddaf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.552862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-056cb713-41ab-4efb-b298-f02080272d36 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:48.554062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-056cb713-41ab-4efb-b298-f02080272d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:48.578319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.578943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.579217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.579490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.580436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:48.580859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.582282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.583811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:48.590427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:48.596551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 391/801] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:48.597584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.635216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 411/802] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:48.636079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cb713-41ab-4efb-b298-f02080272d36 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.729542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9355f-9c03-49a2-b9f3-c79b8c9d3d0b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.741977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cb713-41ab-4efb-b298-f02080272d36 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.775233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.776172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.776874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.777486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.778302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:48.778634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.778942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.779241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.779519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.779790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.780676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:48.780977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.781345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.782322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.792468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 412/803] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:48.793057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.796610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 392/804] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:48.798662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.831539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:48.874843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:48.921181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dca317-176e-4aff-9464-30abe38430d4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.924309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07633536-2a4d-440b-ba91-7e35eacad921 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:48.962297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.963017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.963297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.963424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:48.963612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/59ec11c9fac7430c927f894959023e36/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.963959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:48.964247 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:48.964522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:48.965632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=59ec11c9fac7430c927f894959023e36, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.967057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.975798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:48.977860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:48.982351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 413/805] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:48 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/59ec11c9fac7430c927f894959023e36/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:48.983507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:48.999587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:49.000722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:49.002281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:49.002281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:49.002281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:49.002281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 393/806] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:49.002281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.118552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:49.137890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2bfce-80c5-41d1-9bec-00e138601aee None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.141888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c61b07-211d-4d91-8f29-50a6ffa06d60 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.157119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:49.185861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.187166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.187166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.187166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.188522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.189494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.190913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.192045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.192489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.192903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:49.205203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:49.206505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 14 12:47:49.207395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:49.208354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 394/807] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:49.209159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.209476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.211731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:49.228468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:49.229513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:47:49.230585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:49.233885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 414/808] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:47:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:49.235271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.363596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375da0d-8e28-41b7-b64e-86e2449df831 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.380233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f02b-f85f-4ae7-a9de-b9228582f339 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.409753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.410376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.410717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.410993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.411668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:49.413308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.413515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.428450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 395/809] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:49.428450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.440102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f117bd-e5c0-48e7-b4ac-187a1e2b8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.440803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f117bd-e5c0-48e7-b4ac-187a1e2b8a1f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.441149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f117bd-e5c0-48e7-b4ac-187a1e2b8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.441490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f117bd-e5c0-48e7-b4ac-187a1e2b8a1f None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.442193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f117bd-e5c0-48e7-b4ac-187a1e2b8a1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:49.442568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f117bd-e5c0-48e7-b4ac-187a1e2b8a1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.444078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f117bd-e5c0-48e7-b4ac-187a1e2b8a1f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.449562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 415/810] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:49.453406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc575-8d07-4c7a-972d-60cb6dee4d04 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.453925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc575-8d07-4c7a-972d-60cb6dee4d04 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.454362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc575-8d07-4c7a-972d-60cb6dee4d04 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.456343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 416/811] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:49.460614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc575-8d07-4c7a-972d-60cb6dee4d04 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.469054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:49.471900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:49.543229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e5574-e60f-4628-b22a-ce1e3d539014 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.581570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.582176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.582460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.582729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.583455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:49.583759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.585262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.587882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc575-8d07-4c7a-972d-60cb6dee4d04 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.608582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 396/812] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:49.608582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.637668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1d3bf-d506-4fe3-a296-3e3b359de589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.638308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1d3bf-d506-4fe3-a296-3e3b359de589 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.638580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1d3bf-d506-4fe3-a296-3e3b359de589 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.638850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1d3bf-d506-4fe3-a296-3e3b359de589 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.646643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1d3bf-d506-4fe3-a296-3e3b359de589 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.648094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1d3bf-d506-4fe3-a296-3e3b359de589 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-26e1d3bf-d506-4fe3-a296-3e3b359de589 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:49.660543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:49.661536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 417/813] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1947c9-a7d9-4ac3-80d7-91c2efd27e43 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.667983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1947c9-a7d9-4ac3-80d7-91c2efd27e43 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.668768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1947c9-a7d9-4ac3-80d7-91c2efd27e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.684825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3d1947c9-a7d9-4ac3-80d7-91c2efd27e43 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:49.686002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3d1947c9-a7d9-4ac3-80d7-91c2efd27e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:49.713094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:49.726184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f4dea-562e-4d19-adc6-b7d86788ccdf None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.759276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:49.764865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 418/814] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:49.765717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1947c9-a7d9-4ac3-80d7-91c2efd27e43 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.774984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.776069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.776872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.777346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.778745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:49.779265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.781557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.790029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 397/815] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:49.791180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.880890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1947c9-a7d9-4ac3-80d7-91c2efd27e43 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.907838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1015b8-faf2-442b-9cee-6906cbf2f30d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:49.923506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.924171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.924457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.924852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:49.950835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:49.951319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:49.951836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:49.952974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:49.953535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:49.955277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:49.978121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 398/816] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:49.979406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:49.997524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.002005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.004716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.006489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.095288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30ed5e-c7b1-4937-aee2-a23e473c6e5e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.119080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 419/817] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:47:50.119999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.136329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.136841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.137114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.137383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.138038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.139405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.168053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 399/818] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:47:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:50.168053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.245844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.259627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.264146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863763c-acf4-4331-8c88-64e5d9e1e7d5 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.309952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a858c-717b-4cf9-b3bc-fce83d417699 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.314842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.315711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.316220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.316637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.333084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.334542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:50.354122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:50.355334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:50.360633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:50.360633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:50.360633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:50.360633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 420/819] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:50.360633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.364775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.365496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.365774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.366043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.366636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.368797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:50.377685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:50.378777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:50.380658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 400/820] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:50.381503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.497540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944e0be-a3d0-4bfa-a14d-082a2f1a3ed1 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.504447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6bcba-ca77-471d-b1f4-0046af6affa1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.536404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.537322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.537606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.537880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.540239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.549693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.550550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.550998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.551353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.551568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.552426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:50.552851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.553585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.555271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:50.576038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:50.577619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:50.578677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:50.578677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:50.578677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:50.578677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 421/822] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:50.578677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.578978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 401/822] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:50.578978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.585248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.703366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc60d6-39de-4bd9-8b39-960ea49bf559 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.711772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86e59e-0e4b-428d-88a3-e666e17e441f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.741991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.743008 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.743508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.743972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.751285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.753854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.755262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.755942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.756354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.756836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.758407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] RBAC: Adding query filter params (name=network) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:50.758934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.760580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.765900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 422/823] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:50.768360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:50.769235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:50.770144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:50.771738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.778508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 402/824] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:50.779616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.834186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.859596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:50.899412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121f693-c04f-475d-af70-e3edfe0cefff None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.909493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba792cc7-005a-4e56-9e61-fbde83395262 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:50.951603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.952427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.952701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.952968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.953852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:50.954159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.955675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.960882 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:50.962266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:50.962778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:50.963284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:50.964222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] RBAC: Adding query filter params (type=network) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:50.965571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:50.967800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:50.978785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 423/826] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:50.978785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:50.979208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 403/826] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:50.980746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:51.097651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddb7a8-6cb3-457b-954b-f06e83ee516d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:51.112079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5db5c-fae8-4ad6-8750-6bfd01df5655 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:51.129167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:51.143953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:51.160273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:51.160761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:51.161074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.161417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.161747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.162203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.162669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.163122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.165061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:51.165239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:51.166621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:51.174000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:51.175446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:51.185435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 424/827] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:51.186538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:51.190414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:51.191330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:51.192284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:51.193501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 404/828] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:51.194266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:51.310857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bcb86-9809-4a84-9c45-199cd3f5b54b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:51.317687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b1ba26-b868-4831-98d8-8741164d36b7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:51.350781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae217478-87f4-46ae-bca7-ee7245762e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:51.351632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217478-87f4-46ae-bca7-ee7245762e2b None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.352056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217478-87f4-46ae-bca7-ee7245762e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.352397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae217478-87f4-46ae-bca7-ee7245762e2b None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/c363f0babd8d4180bd4f0dd67bb6b892/roles/67bbea02b9dc4cc392c0ac937749dc57` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.353281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:51.353886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.354160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.354426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.355084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:51.356458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:51.369537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217478-87f4-46ae-bca7-ee7245762e2b None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=c363f0babd8d4180bd4f0dd67bb6b892, role_id=67bbea02b9dc4cc392c0ac937749dc57)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:51.371322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae217478-87f4-46ae-bca7-ee7245762e2b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:51.388043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 425/829] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:47:51 2022] POST /identity/v3/endpoints => generated 337 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:51.388043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:51.409439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 405/830] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:47:51 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/c363f0babd8d4180bd4f0dd67bb6b892/roles/67bbea02b9dc4cc392c0ac937749dc57 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:47:51.409439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8535f-5934-442b-aba6-486fe8d3a0da None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.409439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8535f-5934-442b-aba6-486fe8d3a0da None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.409439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8535f-5934-442b-aba6-486fe8d3a0da None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.409439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 406/831] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:51.414645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670adbae-7878-4d1c-ac61-4145d34e381e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.415225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670adbae-7878-4d1c-ac61-4145d34e381e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.418060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670adbae-7878-4d1c-ac61-4145d34e381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.454742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-670adbae-7878-4d1c-ac61-4145d34e381e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:51.457921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-670adbae-7878-4d1c-ac61-4145d34e381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:51.489057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:51.500996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:51.598147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2e15c-4231-45c7-b7b1-fcd46a251dd8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:51.616555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 407/832] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:47:51.649793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:51.650423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.650688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.650948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.651904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:51.652224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:51.653721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:51.669515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 426/833] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:51.675342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670adbae-7878-4d1c-ac61-4145d34e381e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:51.804320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670adbae-7878-4d1c-ac61-4145d34e381e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:51.849115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:51.850085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:51.850565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:51.851051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:51.852469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=3faaacdf2ff54c06bb4eebf13533a72a) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:51.853016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:51.854680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:51.866788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 408/834] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:51 2022] GET /identity/v3/role_assignments?user.id=3faaacdf2ff54c06bb4eebf13533a72a&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:51.945192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:52.073128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:52.077052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78593618-47b7-4a81-aad5-77788127a81c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:52.115595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:52.116271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:52.116551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:52.116932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:52.128369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:52.133751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:52.135123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:52.136511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 427/835] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:52.140952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:52.176761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:52.265607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619744-b2e5-43b4-a617-602120d7b3c4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:52.302956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:52.303571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:52.303842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:52.304140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:52.304883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:52.305189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:52.307072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:52.320423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 409/836] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:47:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:52.322297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:52.440597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378038e4-f619-48aa-9b51-cd4a2943a502 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:52.484198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5fbd-6867-4e33-8009-75b705caac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:52.485211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5fbd-6867-4e33-8009-75b705caac0e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:52.485746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5fbd-6867-4e33-8009-75b705caac0e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:52.486223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5fbd-6867-4e33-8009-75b705caac0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:52.500471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5fbd-6867-4e33-8009-75b705caac0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:52.502290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5fbd-6867-4e33-8009-75b705caac0e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6eaf5fbd-6867-4e33-8009-75b705caac0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:52.520905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:52.521958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:52.522873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:52.522873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:52.522873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:52.525349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 428/837] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:52.536073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:52.571248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f634d-c8bd-43ff-9e2d-7e24e201cc7f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:52.571562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f634d-c8bd-43ff-9e2d-7e24e201cc7f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:52.571798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f634d-c8bd-43ff-9e2d-7e24e201cc7f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:52.573452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 429/838] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:52.578836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5af3-9af9-429c-99cd-a3f75f942156 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:52.579122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5af3-9af9-429c-99cd-a3f75f942156 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:52.579395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e5af3-9af9-429c-99cd-a3f75f942156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:52.599777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-759e5af3-9af9-429c-99cd-a3f75f942156 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:52.601124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-759e5af3-9af9-429c-99cd-a3f75f942156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:52.610684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:52.622890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:52.646001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69addb9e-78c6-4970-adca-b6ae09231088 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:52.689975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:52.690592 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:52.690930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:52.691143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:52.691785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:52.692114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:52.693480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:52.712317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 410/840] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:52.712719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 430/840] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:52 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:47:52.713652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:52.824223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97d757-f5f1-4b31-8204-45189489469f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:52.887597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:52.888772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:52.889286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:52.889832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:52.904893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:52.906405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:52.916080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:52.924303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:52.925577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:52.926830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 411/841] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:47:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:52.936626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5af3-9af9-429c-99cd-a3f75f942156 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.056380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.094038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e5af3-9af9-429c-99cd-a3f75f942156 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:53.141658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:53.142558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.143088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.143491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.144391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:53.144856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:53.146567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:53.166047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:53.176225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c0ea0-d026-4509-b2b9-b13647f9e47e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:53.176640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 431/842] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Sep 14 12:47:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:53.177752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.210538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:53.211938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.212308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.212650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.213402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:53.215019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:53.225053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:53.226093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:53.227555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 412/843] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:53.232652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.300665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fab2b6-9135-4fb5-896a-b0b0891afc63 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:53.314496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:53.345964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:53.346839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.347123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.347393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.358126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828e433-d386-4f5a-94b7-2c319902d977 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:53.395241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:53.396253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.396752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.397216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.398048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:53.399439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:53.401262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:53.407363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 413/844] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:53.416052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.437284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:53.440808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:53.443113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:53.527155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be0f4e-376d-4f0b-8257-7d8132b5a3bb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:53.551897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 432/845] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:53 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:47:53.556101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:53.559406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.579494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:53.580707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.581632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.582070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.582865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:53.583324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:53.585547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:53.594190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 414/846] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:53.677404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:53.681639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a608c-533a-45ac-a2ca-a6eb925db9c3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:53.727851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd544a4-fc06-4ee9-99f2-ec3fb20a8d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:53.728956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd544a4-fc06-4ee9-99f2-ec3fb20a8d0b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.729475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd544a4-fc06-4ee9-99f2-ec3fb20a8d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.729949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd544a4-fc06-4ee9-99f2-ec3fb20a8d0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.741530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd544a4-fc06-4ee9-99f2-ec3fb20a8d0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:53.744047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd544a4-fc06-4ee9-99f2-ec3fb20a8d0b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-6bd544a4-fc06-4ee9-99f2-ec3fb20a8d0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:53.762418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:53.763460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:53.764424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:53.764424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:53.764424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:53.766721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 433/847] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:53.772432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.893072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01cac9-6a25-41f3-92d8-833c51ab9149 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:53.931091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:53.931703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.932078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.932348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.933093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:53.933391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:53.934750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:53.947154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 415/848] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:53.952571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:53.953210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99624-5af7-4ebc-a81f-19f965cc8584 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.953752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99624-5af7-4ebc-a81f-19f965cc8584 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.954231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c99624-5af7-4ebc-a81f-19f965cc8584 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.956074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 434/849] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:53.961986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02136912-3dac-4282-8356-6458e87472c1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:53.962494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02136912-3dac-4282-8356-6458e87472c1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:53.962784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02136912-3dac-4282-8356-6458e87472c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:53.985186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-02136912-3dac-4282-8356-6458e87472c1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:53.986416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02136912-3dac-4282-8356-6458e87472c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:54.020244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:54.088305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 435/850] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:47:54.092337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf382dc-8845-4e3d-8bf0-9c2a9490870f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:54.129440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e566a73-a5ca-425b-8a8b-f64dbc58e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:54.130097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e566a73-a5ca-425b-8a8b-f64dbc58e674 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.130374 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e566a73-a5ca-425b-8a8b-f64dbc58e674 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.130642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e566a73-a5ca-425b-8a8b-f64dbc58e674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.139791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e566a73-a5ca-425b-8a8b-f64dbc58e674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:54.141423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e566a73-a5ca-425b-8a8b-f64dbc58e674 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1e566a73-a5ca-425b-8a8b-f64dbc58e674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:54.158377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:54.159329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:54.160271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 416/851] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:54.168570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02136912-3dac-4282-8356-6458e87472c1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:54.264817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:54.270382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5008-5f91-4b88-865c-292b97fbc8f8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.270853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5008-5f91-4b88-865c-292b97fbc8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.271318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a5008-5f91-4b88-865c-292b97fbc8f8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.274673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 417/852] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:54.284526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64458ec-a81e-4177-81e8-212afeca296e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.285023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64458ec-a81e-4177-81e8-212afeca296e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.285512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64458ec-a81e-4177-81e8-212afeca296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.290808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02136912-3dac-4282-8356-6458e87472c1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:54.311902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b64458ec-a81e-4177-81e8-212afeca296e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:54.313127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b64458ec-a81e-4177-81e8-212afeca296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:54.329302 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:54.330195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.330615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.331079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.331910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:54.332382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:54.333962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:54.347790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 436/853] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:54.354461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:54.418871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 418/854] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:47:54.420953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64458ec-a81e-4177-81e8-212afeca296e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:54.506945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:54.509461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0291e5-4a78-4ecb-b069-d8941c283c4a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:54.550155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:54.550761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.551034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.551304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.552041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=59ec11c9fac7430c927f894959023e36) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:54.552357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:54.553839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:54.566815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 437/855] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:54 2022] GET /identity/v3/role_assignments?user.id=59ec11c9fac7430c927f894959023e36&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:54.600309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64458ec-a81e-4177-81e8-212afeca296e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:54.660540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:54.662053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.662794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.663551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.685247 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:47:54.696200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:54.698035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:47:54.699914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:54.705345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 419/856] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:47:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:54.713539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:54.725576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:54.817278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:54.833845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e78d1-6c2d-41ec-9b59-a64274660204 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:54.876322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:54.877096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.877784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.878062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.879009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:54.879314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:54.881269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:54.896185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 438/857] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:47:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:54.899361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:54.937881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb21c3-8022-4ac1-9a2d-291a0f7cd163 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:54.939985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:54.990493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:54.991194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:54.991725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:54.992806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:54.994171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:54.995407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:54.997488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:55.010891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:55.012136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:47:55.013029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:55.013759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 420/858] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Sep 14 12:47:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:55.019570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:55.047560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d6ccc-29ec-439e-b25a-b85e09339571 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:55.086843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:55.087839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.088363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.089041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.100829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:55.102718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:55.119668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:55.120879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:55.121807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:55.121807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:55.121807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:55.124055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 439/859] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:55.133312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:55.140326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb02f6-30bb-407a-84b2-f72842ba48f9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:55.183165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:55.184085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.184966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.185403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.186172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:55.186617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:55.188901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:55.195952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 421/860] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:47:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:55.202049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:55.242571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:55.265897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86f664-3208-455d-a74e-f9b197b14dc7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:55.293267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:55.315742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:55.316710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.317182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.317598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.318471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:55.319138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:55.321366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:55.332562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c07afc6-0e97-4b4a-874e-b40bffda2c8d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:55.336742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 440/861] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:55.342435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:55.381919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:55.383643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.384155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.384908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.385737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:55.386239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:55.389095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:55.394740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 422/862] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:47:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:47:55.474067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae89e45-feca-4d22-ac53-58673252e114 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:55.519743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:55.520762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.521242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.521688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.531490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:55.533338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:47:55.548000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:55.549038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:47:55.549982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:55.552348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 441/863] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:47:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:55.561276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:55.672884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:55.682270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6b583-6e2c-4d04-a919-95cc11e4103f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:55.720055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b88b-97b9-4ada-8aee-7e86686381da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:55.720756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b88b-97b9-4ada-8aee-7e86686381da None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.721039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b88b-97b9-4ada-8aee-7e86686381da None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.721312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b88b-97b9-4ada-8aee-7e86686381da None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.722039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b88b-97b9-4ada-8aee-7e86686381da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:55.722339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b88b-97b9-4ada-8aee-7e86686381da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:55.723766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b88b-97b9-4ada-8aee-7e86686381da None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:55.743858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 423/864] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Sep 14 12:47:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:55.749346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:55.795556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:55.864382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ece282-fb96-4f07-9e30-05acd535ba65 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:55.906147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:55.906770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.907049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.907325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.972871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e236fd-d802-4ce7-83f4-da7599d0e78c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.973388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e236fd-d802-4ce7-83f4-da7599d0e78c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.973599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e236fd-d802-4ce7-83f4-da7599d0e78c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.975416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 424/865] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:55.981627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8b38d-cb0a-4536-90ad-2c647e308651 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:55.981931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8b38d-cb0a-4536-90ad-2c647e308651 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:55.982176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8b38d-cb0a-4536-90ad-2c647e308651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:55.993743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:55.995490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:56.003082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2ee8b38d-cb0a-4536-90ad-2c647e308651 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:56.004545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2ee8b38d-cb0a-4536-90ad-2c647e308651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:56.041923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:56.094602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 425/866] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:47:56.105081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 442/867] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:47:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:47:56.110653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8b38d-cb0a-4536-90ad-2c647e308651 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:56.210471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:56.230947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8b38d-cb0a-4536-90ad-2c647e308651 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:56.269173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:56.269733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:56.270008 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:56.270278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:56.281470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:56.282917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:47:56.298148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:56.299130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:47:56.300058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:47:56.300058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:47:56.300058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:56.300058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 426/868] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:56.305427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:56.377057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:56.417947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c578d26-770e-4dcd-943b-5419aecbd3be None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:56.464353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:56.464353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:56.464353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:56.464353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:56.464748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:56.464748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:56.464748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:56.474276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:56.481527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 443/869] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:56.487293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:56.496920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32380c3-87d2-4b0e-a387-ea7399372901 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:56.539438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:56.540400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:56.540843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:56.541212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:56.541993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:56.543561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:56.547729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:56.572356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 427/870] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:47:56 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:56.630460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d2879-78a4-4a2a-916d-181ffc4bf8a6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:56.684154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:56.684818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:56.685095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:56.685417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:56.693318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:56.694878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:47:56.709225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:56.710422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:47:56.712829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:56.716211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 444/871] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:47:56.718025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:56.847244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9865c-e3fa-484c-9439-6110547f60c0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:56.890470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bef18-24e7-42a5-aa28-400edbe1f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:56.891104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bef18-24e7-42a5-aa28-400edbe1f616 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:56.891384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bef18-24e7-42a5-aa28-400edbe1f616 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:56.891657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bef18-24e7-42a5-aa28-400edbe1f616 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:56.892426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bef18-24e7-42a5-aa28-400edbe1f616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:56.892760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bef18-24e7-42a5-aa28-400edbe1f616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:56.894315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bef18-24e7-42a5-aa28-400edbe1f616 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:56.910843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 428/872] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:56.917094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:56.982420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:57.033703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0841ec-db32-4eca-ad11-b805e7b09a56 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:57.049368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e280c9-8c68-414c-9015-b917b1e2086c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:57.050132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e280c9-8c68-414c-9015-b917b1e2086c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:57.050132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e280c9-8c68-414c-9015-b917b1e2086c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:57.051521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 429/873] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:57.057413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72bc3-b57a-4768-8838-c604820b9e34 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:57.057707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72bc3-b57a-4768-8838-c604820b9e34 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:57.057954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c72bc3-b57a-4768-8838-c604820b9e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:57.075657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:57.076306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:57.076581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:57.076852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:57.079154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=c363f0babd8d4180bd4f0dd67bb6b892) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:57.079468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:57.079644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-22c72bc3-b57a-4768-8838-c604820b9e34 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:57.081855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-22c72bc3-b57a-4768-8838-c604820b9e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:57.083621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:57.095396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 445/874] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:47:56 2022] GET /identity/v3/role_assignments?user.id=c363f0babd8d4180bd4f0dd67bb6b892&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:57.161123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:57.186284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 430/875] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:57 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:57.468915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:57.590227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2bf90d-9f1d-4d49-aa89-7498078c3e5f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:57.621085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:57.636053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfab4c-7a8c-4193-a145-0aea2c501a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:57.636053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfab4c-7a8c-4193-a145-0aea2c501a20 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:57.636053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfab4c-7a8c-4193-a145-0aea2c501a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:57.636053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfab4c-7a8c-4193-a145-0aea2c501a20 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:57.636851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfab4c-7a8c-4193-a145-0aea2c501a20 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:57.636851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfab4c-7a8c-4193-a145-0aea2c501a20 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4bbfab4c-7a8c-4193-a145-0aea2c501a20 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:57.645178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:57.647186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:47:57.649443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 446/876] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:47:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:57.653947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72bc3-b57a-4768-8838-c604820b9e34 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:57.737231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a5125-cfe3-4bef-94f5-f6b7e2c9fa33 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:57.737552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a5125-cfe3-4bef-94f5-f6b7e2c9fa33 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:57.737732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a5125-cfe3-4bef-94f5-f6b7e2c9fa33 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:57.739273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 447/877] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:57.745558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483b236-ac8f-4e7b-89a9-3d1062f7d490 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:57.745558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483b236-ac8f-4e7b-89a9-3d1062f7d490 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:57.745558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483b236-ac8f-4e7b-89a9-3d1062f7d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:57.766527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1483b236-ac8f-4e7b-89a9-3d1062f7d490 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:57.767945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c72bc3-b57a-4768-8838-c604820b9e34 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:57.768340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1483b236-ac8f-4e7b-89a9-3d1062f7d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:57.807154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:57.807801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:57.808110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:57.808606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:57.809910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:57.810447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:57.812094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:57.822802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 431/878] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:47:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:57.824305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:57.863323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 448/879] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:57 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:47:57.887235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:57.951180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1dd59-c820-40b3-915e-822c8c7c5639 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:58.009845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719ce52-9fac-4238-a846-22580248bd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:58.010783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719ce52-9fac-4238-a846-22580248bd20 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:58.011260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719ce52-9fac-4238-a846-22580248bd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:58.011731 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719ce52-9fac-4238-a846-22580248bd20 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:58.012956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719ce52-9fac-4238-a846-22580248bd20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:58.013520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719ce52-9fac-4238-a846-22580248bd20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:58.016058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719ce52-9fac-4238-a846-22580248bd20 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:58.025769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 432/880] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:47:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:58.140231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483b236-ac8f-4e7b-89a9-3d1062f7d490 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:58.259392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483b236-ac8f-4e7b-89a9-3d1062f7d490 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:58.274591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:58.296466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56a126-2727-4da7-aad9-66e7de678659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:58.297082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56a126-2727-4da7-aad9-66e7de678659 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:58.297361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56a126-2727-4da7-aad9-66e7de678659 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:58.297637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56a126-2727-4da7-aad9-66e7de678659 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:58.298303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56a126-2727-4da7-aad9-66e7de678659 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:58.299667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56a126-2727-4da7-aad9-66e7de678659 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:58.318300 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 449/881] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:47:58 2022] POST /identity/v3/services => generated 269 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:47:59.053457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0a6b-e2eb-4e91-8b3a-963f93477db5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:59.053983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0a6b-e2eb-4e91-8b3a-963f93477db5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:59.053983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0a6b-e2eb-4e91-8b3a-963f93477db5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:59.055655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 433/882] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:47:59.061190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b66d2-2b76-4108-bd6c-6244e3432f99 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:59.062100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b66d2-2b76-4108-bd6c-6244e3432f99 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:59.062606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b66d2-2b76-4108-bd6c-6244e3432f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:59.083104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7a0b66d2-2b76-4108-bd6c-6244e3432f99 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:59.084721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7a0b66d2-2b76-4108-bd6c-6244e3432f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:59.163691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 450/883] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:59.439481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0a6b-e2eb-4e91-8b3a-963f93477db5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:59.533264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc46e9-a86e-42c9-b2f8-9c0b2210ed24 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:59.533948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc46e9-a86e-42c9-b2f8-9c0b2210ed24 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:59.534427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc46e9-a86e-42c9-b2f8-9c0b2210ed24 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:59.536409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 451/884] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:47:59.543346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ac6c-b14a-43a5-992a-4b75f5597059 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:59.543968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ac6c-b14a-43a5-992a-4b75f5597059 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:59.544470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ac6c-b14a-43a5-992a-4b75f5597059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:59.557961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0a6b-e2eb-4e91-8b3a-963f93477db5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:59.566969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e520ac6c-b14a-43a5-992a-4b75f5597059 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:47:59.568653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e520ac6c-b14a-43a5-992a-4b75f5597059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:47:59.573861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:59.598307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:59.599114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:59.599364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:59.599616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:59.600201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:59.601753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:47:59.611850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:47:59.612923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:47:59.613795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 434/885] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:47:59.621521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:59.672232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 452/886] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:47:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:47:59.733740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10297e3-8916-499a-a9b1-e9f532e42c3a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:59.770480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:59.771100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:59.771382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:59.771657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:59.772322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:59.772628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:59.774133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:47:59.779908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 435/887] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:47:59.785629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ac6c-b14a-43a5-992a-4b75f5597059 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:59.826482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:47:59.921289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ac6c-b14a-43a5-992a-4b75f5597059 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:47:59.971562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:47:59.989574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:47:59.990752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:47:59.991261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:47:59.991749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:47:59.992840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:47:59.993368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:47:59.995342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:00.001950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 453/888] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:47:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:00.008543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:00.030100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:00.099764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2b900-9d22-4d2e-9bbc-00fe9d9434b5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:00.137503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:00.140447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:00.141313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.141738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.142144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.147412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94202aa2-b4b4-4abd-ae74-26d9076df351 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:00.156438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:00.162474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:00.165125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:00.166199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:00.172292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 436/889] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Sep 14 12:47:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:00.173457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:00.193196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:00.194065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.194483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.195022 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.196692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] RBAC: Adding query filter params (interface=public, service_id=3ec72f6ba0b245b886ab07a03cf66d33, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:00.197330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:00.198857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:00.207714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 454/890] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:48:00 2022] GET /identity/v3/endpoints?service_id=3ec72f6ba0b245b886ab07a03cf66d33&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:00.214037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:00.308861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:00.314632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc0c66-4416-4eb6-9f04-fc9bb5956e44 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:00.358581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:00.359202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.359486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.359763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.360467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:00.360778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:00.362279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:00.371785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29719dbe-1913-462f-bbbe-25c7bcf39107 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:00.373817 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 437/891] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Sep 14 12:48:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:00.377482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:00.432590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1b3e6-1733-4e14-8ff4-a233c40dc98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:00.433223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b3e6-1733-4e14-8ff4-a233c40dc98e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.433502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b3e6-1733-4e14-8ff4-a233c40dc98e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.433773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b3e6-1733-4e14-8ff4-a233c40dc98e None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.434392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1b3e6-1733-4e14-8ff4-a233c40dc98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:00.435768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1b3e6-1733-4e14-8ff4-a233c40dc98e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:00.447439 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 455/892] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:48:00 2022] GET /identity/v3/services => generated 1268 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:48:00.516888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13095dd3-23b7-4b96-9752-f20d3979c19c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:00.542994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05bbf0-0738-451f-a4f8-f648873ef1d0 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.543356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05bbf0-0738-451f-a4f8-f648873ef1d0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.543582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05bbf0-0738-451f-a4f8-f648873ef1d0 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.549738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 456/893] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:00.551506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1c36-2085-4897-bb34-1092746090e2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.552159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1c36-2085-4897-bb34-1092746090e2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.552662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1c36-2085-4897-bb34-1092746090e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.564115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:00.564730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.565014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.565285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.580220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:00.582106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:00.586794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6b2b1c36-2085-4897-bb34-1092746090e2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:00.588518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6b2b1c36-2085-4897-bb34-1092746090e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:00.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:00.604832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:00.606324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:00.606324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:00.606324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:00.606324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 438/894] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:00.610697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:00.616135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:00.635768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:00.692079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 457/895] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:00.693445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7bd1-3854-48f9-af27-6a4bb0823f58 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.693729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7bd1-3854-48f9-af27-6a4bb0823f58 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.694004 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b7bd1-3854-48f9-af27-6a4bb0823f58 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.695927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 458/896] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:00.701454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed855-c1a0-47e2-9668-ada3d87fee3e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.701741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed855-c1a0-47e2-9668-ada3d87fee3e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.702015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaed855-c1a0-47e2-9668-ada3d87fee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.721198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bbaed855-c1a0-47e2-9668-ada3d87fee3e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:00.722417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bbaed855-c1a0-47e2-9668-ada3d87fee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:00.745091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71075005-9d31-4619-a9b4-23513cdd4c99 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:00.787078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:00.787820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.788075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.788479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.789677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:00.789974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:00.791444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:00.803390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 459/897] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:00.815361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 439/898] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:00.823984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed855-c1a0-47e2-9668-ada3d87fee3e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:00.915087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:00.935795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaed855-c1a0-47e2-9668-ada3d87fee3e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:00.974717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:00.975363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:00.975643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:00.975923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:00.983926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:00.985481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:00.986866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:48:00.998979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:01.000232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:01.001447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 460/899] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:48:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:01.006037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.082558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:01.123156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2685f1-52bb-4f1f-8da7-83fff0c5d9bc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.129689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08da61-d54f-46a1-b0f5-8c538fa1aaa0 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.179118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.179838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.180319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.180775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.181865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.184279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.186962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.187901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.188385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.188826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.189952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:01.190453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.192669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.209469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 440/900] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:48:00 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:48:01.211227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.222252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:01.233426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 461/901] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:01.234784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.360311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3804e2-dcea-466b-bde2-044522a5b12e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.394459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc209f1-f90e-439a-bb9c-9833a3f6a56d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.395435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:01.408238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.409302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.409657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.409956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.410780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.412903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:01.424981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:01.426065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:01.426987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 441/902] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:01.432674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.447540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.448204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.448482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.448757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.558543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:01.563343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.564816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b24381-52c9-425f-baa1-f12351ca4adc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.565211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.603714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.604767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.605249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.605697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.606493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:01.606799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.608219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.621248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 442/903] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:01.622592 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.696743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:01.699643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 462/904] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:48:01.705845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.746873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927cbb7-21ed-47dc-b674-b4bee4e6702e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.786674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.787353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.787697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.788079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.789472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:01.789842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.791289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.802122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 443/905] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:01.803563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.825868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d9e8b-8c34-4d1d-b022-e6a07370b289 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.839816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:01.867464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.868488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.868883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.869261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.880999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.882769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:01.899980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:01.901275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:01.902617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:01.902617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:01.902617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:01.908103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 463/906] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:01.909206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:01.919355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88da63-13f0-430e-94f8-ba0b59001683 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:01.953017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:01.969916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:01.971309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:01.972115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:01.972572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:01.973813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] RBAC: Adding query filter params (interface=public, service_id=f240cdcae6ee4a12844a3daabb503cd5, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:01.974701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:01.976342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:01.989058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 444/907] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/endpoints?service_id=f240cdcae6ee4a12844a3daabb503cd5&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:01.990794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:02.033760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab129b-aa78-44b3-92c3-197279dbfad3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:02.076414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:02.077316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:02.077739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:02.078153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:02.078940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:02.080168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:02.083247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:02.101689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 464/908] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:02.106887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:02.114628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333edaca-6db5-487a-88e6-9853c2a12e04 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:02.129155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:02.161075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:02.161733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:02.162305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:02.162749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:02.164136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:02.167039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:02.180160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 445/909] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:48:01 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:48:02.252697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a7cbbc-369e-4473-8da6-8f3b4af9792d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:02.299088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:02.300157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:02.300648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:02.301155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:02.309865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:02.311696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:48:02.325118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:02.326116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:02.327111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:02.329784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 465/910] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:02.336757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:02.396939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:02.462849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304360-d057-4ce9-b09f-db5b715bde24 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:02.508707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fcd08-095b-4003-8041-2a045698ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:02.509320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fcd08-095b-4003-8041-2a045698ac96 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:02.509597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fcd08-095b-4003-8041-2a045698ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:02.509937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fcd08-095b-4003-8041-2a045698ac96 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:02.510636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fcd08-095b-4003-8041-2a045698ac96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:02.510937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fcd08-095b-4003-8041-2a045698ac96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:02.512394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fcd08-095b-4003-8041-2a045698ac96 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:02.528714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 446/911] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:48:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:02.535080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:02.628466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:02.676704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a9a7d-e55b-48c4-9693-59dbff5ba670 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:02.716949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f63c0a-76fb-445f-beab-9a836890cf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:02.717786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63c0a-76fb-445f-beab-9a836890cf08 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:02.718063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63c0a-76fb-445f-beab-9a836890cf08 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:02.718333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f63c0a-76fb-445f-beab-9a836890cf08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:02.719062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63c0a-76fb-445f-beab-9a836890cf08 None admin] RBAC: Adding query filter params (role.id=46e191bb5708421e98b22d384ea7ceb0, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=c363f0babd8d4180bd4f0dd67bb6b892) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:02.719368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63c0a-76fb-445f-beab-9a836890cf08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:02.720862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f63c0a-76fb-445f-beab-9a836890cf08 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:02.728623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 466/912] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:02 2022] GET /identity/v3/role_assignments?user.id=c363f0babd8d4180bd4f0dd67bb6b892&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=46e191bb5708421e98b22d384ea7ceb0 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:02.798571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7dd4e-4830-4cdb-b8a9-7163eef0ddf8 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:02.798910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7dd4e-4830-4cdb-b8a9-7163eef0ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:02.799129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7dd4e-4830-4cdb-b8a9-7163eef0ddf8 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:02.800827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 447/913] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:02.807384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db5e4-25ed-41bf-ba5c-0d6b7f11384e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:02.807701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db5e4-25ed-41bf-ba5c-0d6b7f11384e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:02.807945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db5e4-25ed-41bf-ba5c-0d6b7f11384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:02.831999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d12db5e4-25ed-41bf-ba5c-0d6b7f11384e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:02.833308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d12db5e4-25ed-41bf-ba5c-0d6b7f11384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:02.913393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 467/914] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:03.190220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7dd4e-4830-4cdb-b8a9-7163eef0ddf8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:03.307884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7dd4e-4830-4cdb-b8a9-7163eef0ddf8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:03.328363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:03.360350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:03.360999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:03.361278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:03.361551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:03.362142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:03.363524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:03.373150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:03.374221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:03.375495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 448/915] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:48:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:03.380660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db5e4-25ed-41bf-ba5c-0d6b7f11384e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:03.471599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:03.515850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db5e4-25ed-41bf-ba5c-0d6b7f11384e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:03.565517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b3668-3fc5-4b01-9001-25a46630dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:03.566133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b3668-3fc5-4b01-9001-25a46630dace None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:03.566407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b3668-3fc5-4b01-9001-25a46630dace None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:03.566672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b3668-3fc5-4b01-9001-25a46630dace None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:03.567304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b3668-3fc5-4b01-9001-25a46630dace None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:03.567601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b3668-3fc5-4b01-9001-25a46630dace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:03.569010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b3668-3fc5-4b01-9001-25a46630dace None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:03.575076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 468/916] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:48:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:03.580943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:03.658701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca7f4-35a7-4abe-8a01-4a3a088c9788 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:03.659019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca7f4-35a7-4abe-8a01-4a3a088c9788 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:03.659265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ca7f4-35a7-4abe-8a01-4a3a088c9788 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:03.660921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 469/917] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:03.667088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6c3d-17d0-4138-962a-8c83627bf5d2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:03.667376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6c3d-17d0-4138-962a-8c83627bf5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:03.667644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb6c3d-17d0-4138-962a-8c83627bf5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:03.685999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-15fb6c3d-17d0-4138-962a-8c83627bf5d2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:03.687244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-15fb6c3d-17d0-4138-962a-8c83627bf5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:03.706064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1237ec-38d4-4a7a-af2e-aba2a1cc3ed1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:03.762698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:03.763239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:03.763741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:03.764039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:03.765139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:03.765649 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:03.767475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:03.775032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 449/918] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Sep 14 12:48:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:03.780603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:03.784403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 470/919] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:03.827778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:03.893645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4271cee-4dca-45f5-9a05-c028004a3680 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:03.931354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:03.932246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:03.932704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:03.933118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:03.933936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:03.935452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:03.959292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 450/920] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:48:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:04.072925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb6c3d-17d0-4138-962a-8c83627bf5d2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:04.148466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:04.195082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb6c3d-17d0-4138-962a-8c83627bf5d2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:04.239876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:04.240652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:04.240943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:04.241248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:04.242498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:04.243884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:04.253723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:04.254794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:04.255645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 471/921] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:04.261863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:04.372558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:04.380708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5468b-c542-45cd-8050-b7a27364ee9b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:04.421240 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ea37-07f6-4584-888d-d8d4b4157283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:04.421869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ea37-07f6-4584-888d-d8d4b4157283 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:04.422162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ea37-07f6-4584-888d-d8d4b4157283 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:04.422446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ea37-07f6-4584-888d-d8d4b4157283 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:04.423107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ea37-07f6-4584-888d-d8d4b4157283 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:04.423410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ea37-07f6-4584-888d-d8d4b4157283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:04.424858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ea37-07f6-4584-888d-d8d4b4157283 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:04.430984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 451/922] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:04.436910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:04.563723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07d903-d1cc-4f08-87f8-1267fa30a4ce None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:04.588798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:04.602942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa378-b63f-49cd-9a44-1c5c660037d6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:04.603287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa378-b63f-49cd-9a44-1c5c660037d6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:04.603529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa378-b63f-49cd-9a44-1c5c660037d6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:04.605319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 452/923] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:04.610994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:04.611194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144c6c2-f3dc-43c3-bcc5-227cb373bee0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:04.611410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144c6c2-f3dc-43c3-bcc5-227cb373bee0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:04.611589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144c6c2-f3dc-43c3-bcc5-227cb373bee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:04.612433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:04.612943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:04.613421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:04.614374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:04.614910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:04.616338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:04.625294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 472/924] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:04.637386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:04.639083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c144c6c2-f3dc-43c3-bcc5-227cb373bee0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:04.640639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c144c6c2-f3dc-43c3-bcc5-227cb373bee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:04.756228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 453/925] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:04.770297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a306aa-7829-429e-8a0e-8218dfb5c1e7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:04.811752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:04.812867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:04.813434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:04.814084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:04.815274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] RBAC: Adding query filter params (interface=public, service_id=efbf1c5e6dc6447c98b160aef96f5f74, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:04.815898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:04.817878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:04.826582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 473/926] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:48:04 2022] GET /identity/v3/endpoints?service_id=efbf1c5e6dc6447c98b160aef96f5f74&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:04.833186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144c6c2-f3dc-43c3-bcc5-227cb373bee0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:04.933628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:04.947806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144c6c2-f3dc-43c3-bcc5-227cb373bee0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:04.990755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aa797-d11a-42ac-81f8-de01c00b16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:04.991413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aa797-d11a-42ac-81f8-de01c00b16bd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:04.991733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aa797-d11a-42ac-81f8-de01c00b16bd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:04.992002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aa797-d11a-42ac-81f8-de01c00b16bd None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:04.992749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aa797-d11a-42ac-81f8-de01c00b16bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:04.994204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990aa797-d11a-42ac-81f8-de01c00b16bd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:05.001301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 454/927] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:48:04 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:48:05.074098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:05.095013 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d9768-f8fd-4551-8e54-e5ad4b433023 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:05.095353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d9768-f8fd-4551-8e54-e5ad4b433023 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:05.095575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d9768-f8fd-4551-8e54-e5ad4b433023 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:05.097345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 455/928] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:05.106896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59145-a0ae-4dbf-a41a-f5ffefb1752b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:05.107321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59145-a0ae-4dbf-a41a-f5ffefb1752b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:05.108280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59145-a0ae-4dbf-a41a-f5ffefb1752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:05.138068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-39f59145-a0ae-4dbf-a41a-f5ffefb1752b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:05.139334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-39f59145-a0ae-4dbf-a41a-f5ffefb1752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:05.155166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:05.252721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8bcbe-f83a-44ce-9857-28c494678af6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:05.253137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 456/929] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:05.298949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:05.300061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:05.300555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:05.301061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:05.301862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:05.303471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:05.325152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:05.326191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:05.327573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 474/930] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Sep 14 12:48:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:05.338003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59145-a0ae-4dbf-a41a-f5ffefb1752b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:05.486746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:05.517236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59145-a0ae-4dbf-a41a-f5ffefb1752b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:05.570859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:05.571495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:05.571774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:05.572070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:05.572723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:05.573242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:05.575633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:05.581781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 457/931] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:05.590792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:05.593733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:05.759559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d7935-6cac-42ba-9bc4-0bfca452297b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:05.780546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a65df9-08fa-4b64-8822-c651f5f3fc6a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:05.800824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:05.812752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:05.813816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:05.814299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:05.814770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:05.827962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:05.831830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:05.832490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:05.832769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:05.833040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:05.833675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:05.833977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:05.834735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:05.835857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:05.836747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:05.837396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:05.844225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 458/932] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Sep 14 12:48:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:05.845476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:05.848053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 475/933] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:05.849054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:05.858698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:05.992723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6f976-c9b0-4aba-a1e7-dcd8a93cc630 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:06.019460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55408-0063-439c-a07a-a3f1c8719161 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:06.035676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:06.036679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.037218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.037759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.039608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:06.040480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:06.042750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:06.059902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 459/934] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Sep 14 12:48:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:06.061258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:06.070176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:06.071177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.071461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.071734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.073034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:06.073974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:06.112496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 476/935] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:48:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:06.169668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:06.238448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532191c-43b5-4ccb-9266-7deabdea4950 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:06.291919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:06.292523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.292802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.293078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.309038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:06.310711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:06.331912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:06.333755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:06.334931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:06.334931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:06.334931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:06.334931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 460/936] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:06.339997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:06.384999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:06.478172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b082ef5-421c-40fb-a46b-298ce3d26c71 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:06.521006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc71b4-d3ee-4d56-b9c9-e6ba6989f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:06.521729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc71b4-d3ee-4d56-b9c9-e6ba6989f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.522010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc71b4-d3ee-4d56-b9c9-e6ba6989f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.522288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc71b4-d3ee-4d56-b9c9-e6ba6989f3f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.523132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc71b4-d3ee-4d56-b9c9-e6ba6989f3f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:06.523432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc71b4-d3ee-4d56-b9c9-e6ba6989f3f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:06.525151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc71b4-d3ee-4d56-b9c9-e6ba6989f3f0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:06.541170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 477/937] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:06.547883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:06.658668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0512-f4c2-4e62-be54-1605565a6dbc None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.659208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0512-f4c2-4e62-be54-1605565a6dbc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.659296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b0512-f4c2-4e62-be54-1605565a6dbc None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.661145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 478/938] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:06.667463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa00f9-41d1-4f3d-9803-d1ff95a362f4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.667742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa00f9-41d1-4f3d-9803-d1ff95a362f4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.668044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa00f9-41d1-4f3d-9803-d1ff95a362f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.681553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e052-06e0-4a3a-ba33-1f95a218bf59 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:06.688773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-28aa00f9-41d1-4f3d-9803-d1ff95a362f4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:06.689974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-28aa00f9-41d1-4f3d-9803-d1ff95a362f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:06.704428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:06.730590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:06.731229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.731509 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.732082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.742598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:06.744107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:48:06.760258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:06.761889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:06.762833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 461/939] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:48:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:06.768063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:06.784286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 479/940] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:06.893737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3480972-b337-4e3c-8dc0-d2b16aeb0eb9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:06.937216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:06.938007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:06.938294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:06.938572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:06.939473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:06.939786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:06.941306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:06.962823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 462/941] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Sep 14 12:48:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:06.968994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa00f9-41d1-4f3d-9803-d1ff95a362f4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:06.997408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:07.084095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa00f9-41d1-4f3d-9803-d1ff95a362f4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.093028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:07.123401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.123871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.124185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.124454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.135244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:07.136191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:07.138285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:07.155808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:07.156848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:07.162675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:07.162675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:07.162675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:07.162675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 480/942] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:07.162675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:07.242609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec04eb-326f-4f68-9327-d0e584ecd1eb None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.250403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:07.278813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74706f-496a-44b6-b569-e0c7d1a4f81f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.287749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.289347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.289861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.290322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.291279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:07.293036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:07.296171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING keystone.server.flask.common [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 14 12:48:07.316202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.316921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.317303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.317635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.318165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.sql.core [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 12:48:07.318165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 12:48:07.318165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [parameters: {'id': '27dcf8dea5e641aa871bbf1a7fb503c4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 12:48:07.318165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 12:48:07.318443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:07.318721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:07.320226 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:07.338002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 481/943] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:07.339367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27dcf8dea5e641aa871bbf1a7fb503c4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27dcf8dea5e641aa871bbf1a7fb503c4. Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 12:48:07.342711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 14 12:48:07.343568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application yield resource Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise self.value Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application session.commit() Sep 14 12:48:07.344581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.flush() Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application compat.raise_( Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 12:48:07.345512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 12:48:07.346436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 12:48:07.347262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [parameters: {'id': '27dcf8dea5e641aa871bbf1a7fb503c4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:07.348424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:07.349235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 27dcf8dea5e641aa871bbf1a7fb503c4. Sep 14 12:48:07.351578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.359525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 463/944] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Sep 14 12:48:07 2022] POST /identity/v3/projects => generated 262 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:07.361408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:07.464640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1348f-aa18-4fe3-887f-a5b275ec7798 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.474147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:07.489571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d368d-47eb-488a-967f-3ef2a015d37f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.514557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.515387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.516045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.516160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.518639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:07.526135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:07.528040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:07.536043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.536993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.537458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.537913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:48:07.543634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:07.545412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:07.546674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:07.550447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 482/945] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:07.551874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:07.552844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:07.557585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:48:07.574397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:07.575395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:07.576369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:07.583526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 464/946] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:07.586216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:07.685960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481dcd5-b9d0-40b9-b8dc-0c81ea43d83c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.711686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96d9a3-9190-4f15-82fe-9202a7af6690 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.732391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5508ada-92d7-4ccc-88c4-dd43cf6b303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.732928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5508ada-92d7-4ccc-88c4-dd43cf6b303c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.733155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5508ada-92d7-4ccc-88c4-dd43cf6b303c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.733423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5508ada-92d7-4ccc-88c4-dd43cf6b303c None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.734737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5508ada-92d7-4ccc-88c4-dd43cf6b303c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:07.735055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5508ada-92d7-4ccc-88c4-dd43cf6b303c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:07.736633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5508ada-92d7-4ccc-88c4-dd43cf6b303c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:07.755756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 483/947] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:07.757892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc22b51-f178-4773-a128-2bbc466bb8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.758056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da122b-86f8-481e-8312-6fac6c6c2531 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.758391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da122b-86f8-481e-8312-6fac6c6c2531 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.758521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22b51-f178-4773-a128-2bbc466bb8fe None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.758772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22b51-f178-4773-a128-2bbc466bb8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.758879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da122b-86f8-481e-8312-6fac6c6c2531 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.759048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc22b51-f178-4773-a128-2bbc466bb8fe None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.759725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22b51-f178-4773-a128-2bbc466bb8fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:07.760057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22b51-f178-4773-a128-2bbc466bb8fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:07.764094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc22b51-f178-4773-a128-2bbc466bb8fe None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:07.764235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 484/948] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:07.764235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da122b-86f8-481e-8312-6fac6c6c2531 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:07.791129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 465/949] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:48:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:07.792741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16a67-16db-4077-b7d7-104918c24a15 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.793201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16a67-16db-4077-b7d7-104918c24a15 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.793617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc16a67-16db-4077-b7d7-104918c24a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:07.816528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cfc16a67-16db-4077-b7d7-104918c24a15 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:07.818528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cfc16a67-16db-4077-b7d7-104918c24a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:07.823234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:07.873796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:07.928909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 466/950] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:07.941063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da122b-86f8-481e-8312-6fac6c6c2531 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:07.996994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:07.997595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:07.997871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:07.998138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/c363f0babd8d4180bd4f0dd67bb6b892/roles/46e191bb5708421e98b22d384ea7ceb0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:08.000600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=c363f0babd8d4180bd4f0dd67bb6b892, role_id=46e191bb5708421e98b22d384ea7ceb0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:08.002054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:08.019408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 485/951] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:48:07 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/c363f0babd8d4180bd4f0dd67bb6b892/roles/46e191bb5708421e98b22d384ea7ceb0 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:48:08.274498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16a67-16db-4077-b7d7-104918c24a15 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:08.393465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc16a67-16db-4077-b7d7-104918c24a15 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:08.439114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334317c2-431d-48b0-bee7-8527f8b94923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:08.440200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334317c2-431d-48b0-bee7-8527f8b94923 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:08.440688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334317c2-431d-48b0-bee7-8527f8b94923 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:08.441198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334317c2-431d-48b0-bee7-8527f8b94923 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:08.441992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334317c2-431d-48b0-bee7-8527f8b94923 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:08.443593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334317c2-431d-48b0-bee7-8527f8b94923 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-334317c2-431d-48b0-bee7-8527f8b94923 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:08.454726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:08.456064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:08.456982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:08.459869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 467/952] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:08.469833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:08.603258 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c748588-fdfb-46c0-a1cf-880da2f4add2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:08.604587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f6af-d726-4813-b00f-74909e12550f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:08.605066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f6af-d726-4813-b00f-74909e12550f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:08.605251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b86f6af-d726-4813-b00f-74909e12550f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:08.608065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 468/953] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:08.612536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6204-e511-42e6-a6f4-5a682ae62e68 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:08.612830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6204-e511-42e6-a6f4-5a682ae62e68 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:08.613099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b6204-e511-42e6-a6f4-5a682ae62e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:08.621363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:08.625882 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:08.647959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-827b6204-e511-42e6-a6f4-5a682ae62e68 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:08.650101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-827b6204-e511-42e6-a6f4-5a682ae62e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:08.653927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:08.654732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:08.655117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:08.655495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:08.656282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:08.656693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:08.658207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:08.664802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 486/954] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:08.673520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:08.752577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 469/955] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:08.807798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be34aa-cf62-479e-b574-026d2e3d4a91 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:08.847727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:08.848379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:08.848659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:08.848933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:08.849579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:08.849885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:08.851842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:08.858130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 487/956] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:08.864519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b6204-e511-42e6-a6f4-5a682ae62e68 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:08.984380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b6204-e511-42e6-a6f4-5a682ae62e68 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:09.021573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:09.022560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:09.023777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:09.024329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:09.025223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:09.027082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:09.032239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:09.048390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:09.053900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 470/957] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:48:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:09.104695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:09.177261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235d64-5a26-4959-8d0f-da911b123309 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:09.225324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:09.226046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:09.226819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:09.227100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:09.227683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:09.229161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:09.239487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:09.240693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:09.242256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:09.245875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 488/958] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:09.247329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:09.368723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e4cc4-bad0-495f-a646-9ed7e01f17ba None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:09.406880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8a1d2-00fb-45f8-a922-6d52bc6d4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:09.407657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a1d2-00fb-45f8-a922-6d52bc6d4133 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:09.407941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a1d2-00fb-45f8-a922-6d52bc6d4133 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:09.408281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8a1d2-00fb-45f8-a922-6d52bc6d4133 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:09.409156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8a1d2-00fb-45f8-a922-6d52bc6d4133 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:09.409469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8a1d2-00fb-45f8-a922-6d52bc6d4133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:09.411146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8a1d2-00fb-45f8-a922-6d52bc6d4133 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:09.424191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 471/959] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:48:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:09.427180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:09.580362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430e1b7-4a96-4ab2-b31f-4767823bf906 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:09.584332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:09.628790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d2e48-ac1e-4a65-ace5-f4a4ecda4e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:09.629408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d2e48-ac1e-4a65-ace5-f4a4ecda4e21 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:09.629686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d2e48-ac1e-4a65-ace5-f4a4ecda4e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:09.629995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d2e48-ac1e-4a65-ace5-f4a4ecda4e21 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:09.630687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d2e48-ac1e-4a65-ace5-f4a4ecda4e21 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:09.630990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d2e48-ac1e-4a65-ace5-f4a4ecda4e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:09.632444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d2e48-ac1e-4a65-ace5-f4a4ecda4e21 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:09.637719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 489/960] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:48:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:10.318132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6513-cfb2-4a2c-a9af-57e9338a82f2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:10.318851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6513-cfb2-4a2c-a9af-57e9338a82f2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:10.318851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d6513-cfb2-4a2c-a9af-57e9338a82f2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:10.321021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 472/961] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:10.331892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a1b78-31f9-4631-902b-0f04399a47bf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:10.331892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a1b78-31f9-4631-902b-0f04399a47bf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:10.331892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a1b78-31f9-4631-902b-0f04399a47bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:10.356870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a31a1b78-31f9-4631-902b-0f04399a47bf None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:10.358522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a31a1b78-31f9-4631-902b-0f04399a47bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:10.450251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 490/962] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:10.483696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071a992-b95e-4837-a3fa-97da6ff798ea None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:10.484032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071a992-b95e-4837-a3fa-97da6ff798ea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:10.484286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071a992-b95e-4837-a3fa-97da6ff798ea None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:10.488127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 473/963] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:10.503442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0cb0-201d-48a3-a2d2-5ade207a973a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:10.503747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0cb0-201d-48a3-a2d2-5ade207a973a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:10.503992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0cb0-201d-48a3-a2d2-5ade207a973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:10.531311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-894c0cb0-201d-48a3-a2d2-5ade207a973a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:10.532537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-894c0cb0-201d-48a3-a2d2-5ade207a973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:10.669895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 491/964] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:10.743099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071a992-b95e-4837-a3fa-97da6ff798ea None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:10.807369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:10.863053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071a992-b95e-4837-a3fa-97da6ff798ea None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:10.910032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:10.910657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:10.910945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:10.911232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:10.911891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:10.913829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:10.929583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.sql.core [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 12:48:10.929583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 12:48:10.929583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [parameters: {'user_id': '986cda2381da40a19427d54db6d634a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 12:48:10.929583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Sep 14 12:48:10.937762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 12:48:10.938905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application yield resource Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application next(self.gen) Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.rollback() Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.force_reraise() Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise self.value Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application session.commit() Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 14 12:48:10.940199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._prepare_impl() Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.session.flush() Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._flush(objects) Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application compat.raise_( Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application flush_context.execute() Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rec.execute(self) Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 14 12:48:10.941421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 14 12:48:10.943058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result = self._query(query) Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application conn.query(q) Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application result.read() Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 14 12:48:10.945739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [parameters: {'user_id': '986cda2381da40a19427d54db6d634a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:10.956242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 14 12:48:10.958224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 14 12:48:10.961402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 14 12:48:10.961402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 14 12:48:10.961402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 14 12:48:10.961402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 14 12:48:10.961402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 14 12:48:10.961402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:10.961402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 474/965] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Sep 14 12:48:10 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:10.962319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0cb0-201d-48a3-a2d2-5ade207a973a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:10.983950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:11.026044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:11.075102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0cb0-201d-48a3-a2d2-5ade207a973a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:11.123812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:11.124840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.125122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.125401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.137312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:11.139568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:11.143995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23841d-149f-4647-b281-2628fd24a516 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:48:11.157902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:11.160528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:11.162838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 492/966] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:48:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:11.166783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:11.171603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:11.201987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:11.203593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.204270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.204752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.221418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:11.229631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:11.230631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:11.231489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:11.233448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 475/967] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Sep 14 12:48:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:11.239386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:11.285422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:11.307971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a826e-0416-4d6b-b8bc-a0300bda566e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:11.355959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415b968-29f4-436e-8f60-fe4749c3b8d5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:11.357445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:11.358781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.360236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.360741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.361696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:11.362180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:11.363790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:11.405999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:11.406735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.407084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.407483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.408280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:11.408653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:11.410349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:11.426216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 493/968] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Sep 14 12:48:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:11.428364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 476/969] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Sep 14 12:48:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:11.439309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:11.572689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c39d-e285-4805-a4c4-f3d6f6c6e17c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:11.627174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc4e6f-a0e3-4c88-a071-46900ad6136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:11.627843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4e6f-a0e3-4c88-a071-46900ad6136e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.628156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4e6f-a0e3-4c88-a071-46900ad6136e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.628431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc4e6f-a0e3-4c88-a071-46900ad6136e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.642482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc4e6f-a0e3-4c88-a071-46900ad6136e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:11.643584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc4e6f-a0e3-4c88-a071-46900ad6136e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:11.646487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-bbdc4e6f-a0e3-4c88-a071-46900ad6136e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:11.661259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:11.662478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:11.664378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:11.664378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:11.664378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:11.664378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 494/970] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:11.671161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:11.718994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:11.734425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7ac3-3f0f-4d4f-a958-f84964f0289b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.734755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7ac3-3f0f-4d4f-a958-f84964f0289b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.734980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d7ac3-3f0f-4d4f-a958-f84964f0289b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.737775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 495/971] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:11.742576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2fcb-a49f-454f-b303-53a0c4f4c9a0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.742853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2fcb-a49f-454f-b303-53a0c4f4c9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.743132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2fcb-a49f-454f-b303-53a0c4f4c9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.768325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-655a2fcb-a49f-454f-b303-53a0c4f4c9a0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:11.769973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-655a2fcb-a49f-454f-b303-53a0c4f4c9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:11.796890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d6dd-2198-499d-bda2-18f913bd69a8 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:11.838850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8b4b3-93c2-4098-b176-f4fc8fd49d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:11.839447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b4b3-93c2-4098-b176-f4fc8fd49d3a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:11.839725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b4b3-93c2-4098-b176-f4fc8fd49d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:11.839988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8b4b3-93c2-4098-b176-f4fc8fd49d3a None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:11.840654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8b4b3-93c2-4098-b176-f4fc8fd49d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:11.840953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8b4b3-93c2-4098-b176-f4fc8fd49d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:11.842313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8b4b3-93c2-4098-b176-f4fc8fd49d3a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:11.848147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 496/972] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:11.860319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 477/973] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:11.861183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2fcb-a49f-454f-b303-53a0c4f4c9a0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:11.977625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2fcb-a49f-454f-b303-53a0c4f4c9a0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.005492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:12.016333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.016972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.017251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.017516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.024979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeccd8f-03ec-4720-ba9f-fa9a6defa65f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.025264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeccd8f-03ec-4720-ba9f-fa9a6defa65f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.025541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeccd8f-03ec-4720-ba9f-fa9a6defa65f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.026756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.027288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 478/974] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:12.028255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.032353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9d342-cece-48ef-b307-07838715ced8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.032635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9d342-cece-48ef-b307-07838715ced8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.032908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9d342-cece-48ef-b307-07838715ced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:48:12.043237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:12.049566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 497/975] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:48:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:12.050614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.052472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dac9d342-cece-48ef-b307-07838715ced8 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:12.054917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dac9d342-cece-48ef-b307-07838715ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:12.128141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 479/976] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:12.138416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9d342-cece-48ef-b307-07838715ced8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.169131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:12.176200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4488c-f5e8-4a3e-82ff-19d2c5c0c862 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.213704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.214338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.214617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.214860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.215583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:12.215886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.218201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.247707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 498/977] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:12.248713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.252569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9d342-cece-48ef-b307-07838715ced8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.293209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.293870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.294154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.294433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.295036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.296500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:12.306275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:12.308490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:12.309431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:12.312537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 480/978] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:12.313438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.315507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:12.384174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d05a83-3dfd-4583-a36e-1906f92f8e9e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.425064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.425730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.425901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:12.426341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.426341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.438537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8fcd2-23c7-411e-8aa0-1bf38b35c072 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.475455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.476216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.476502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.476774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.477406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:12.477708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.479079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.484277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 481/979] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:12.484870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.501411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.502779 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.559628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:12.610094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c74679-381e-48c4-a720-01dd3f3e112f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.628403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 499/980] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:48:12.628403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.657561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.658186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.658468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.658745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.659410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.660839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.678409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 482/981] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:48:12 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:12.679649 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.713250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:12.776958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bafe7-b036-4d3f-8063-f33775c25b7d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.831974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.832866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.833151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.833535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.834355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:12.834665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.837156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.840585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f1514-ca8f-420f-bc22-b5e51942ffdc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:12.848587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 500/982] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:12.853108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:12.859987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:12.904478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:12.904478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:12.904478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:12.904478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:12.920539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:12.922132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:12.940161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:12.941301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:12.942608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:12.942608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:12.942608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:12.942608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 483/983] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:12.950905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:13.043537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d06ca8-9d59-4c47-99df-ac37432a3556 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:13.071546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:13.093509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:13.094380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:13.094800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:13.095141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:13.096158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] RBAC: Adding query filter params (interface=admin, service_id=efbf1c5e6dc6447c98b160aef96f5f74, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:13.096626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:13.098392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:13.110084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 501/984] 10.222.0.50 () {56 vars in 1249 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/endpoints?service_id=efbf1c5e6dc6447c98b160aef96f5f74&interface=admin®ion_id=RegionOne => generated 193 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:13.111451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:13.149160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305836c0-7a97-43c3-9cc5-71c1f86f161a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:13.189435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:13.190045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:13.190370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:13.190733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:13.191424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:13.191994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:13.193250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:13.202998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:13.213028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 484/985] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:13.214430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:13.252072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a425c-5f0c-438d-9332-02e8412c372a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:13.301879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:13.302890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:13.303367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:13.303890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:13.305048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:13.307541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:13.321198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 502/986] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:48:13 2022] GET /identity/v3/services => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:48:13.359547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b8eab-34f7-4b6c-82a7-7095cbe0ee92 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:13.403402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:13.425607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:13.426711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:13.427322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:13.427651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:13.440573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:13.443504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:48:13.467999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:13.469165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:13.470254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:13.472123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 485/987] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:13.481581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:13.640637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97df66-8790-4e85-bd02-2065fe20f49e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:13.689108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:13.694832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b6497-1045-43e8-8f20-e52b30df34fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:13.695442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b6497-1045-43e8-8f20-e52b30df34fd None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:13.695717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b6497-1045-43e8-8f20-e52b30df34fd None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:13.695990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b6497-1045-43e8-8f20-e52b30df34fd None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:13.696900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b6497-1045-43e8-8f20-e52b30df34fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:13.697207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b6497-1045-43e8-8f20-e52b30df34fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:13.698649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b6497-1045-43e8-8f20-e52b30df34fd None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:13.718742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 503/988] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:48:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:13.725141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:13.869898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9c796-f94d-48b2-b8fa-3b9174551e0d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:13.913901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13be371-d39f-4988-9073-85dd22cbf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:13.917103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be371-d39f-4988-9073-85dd22cbf8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:13.917103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be371-d39f-4988-9073-85dd22cbf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:13.917103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be371-d39f-4988-9073-85dd22cbf8c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:13.917103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13be371-d39f-4988-9073-85dd22cbf8c4 None admin] RBAC: Adding query filter params (role.id=46e191bb5708421e98b22d384ea7ceb0, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=c363f0babd8d4180bd4f0dd67bb6b892) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:13.917103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13be371-d39f-4988-9073-85dd22cbf8c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:13.918049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13be371-d39f-4988-9073-85dd22cbf8c4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:13.927911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 486/989] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:13 2022] GET /identity/v3/role_assignments?user.id=c363f0babd8d4180bd4f0dd67bb6b892&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=46e191bb5708421e98b22d384ea7ceb0 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:15.060450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552119ba-8dbd-42e9-a1f1-336bd8a8ddd8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:15.060982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552119ba-8dbd-42e9-a1f1-336bd8a8ddd8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:15.060982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552119ba-8dbd-42e9-a1f1-336bd8a8ddd8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:15.062369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 504/990] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:15.067919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e54ffd-18fd-4e81-b90f-df948e9c3104 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:15.068412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e54ffd-18fd-4e81-b90f-df948e9c3104 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:15.068601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e54ffd-18fd-4e81-b90f-df948e9c3104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:15.087800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-20e54ffd-18fd-4e81-b90f-df948e9c3104 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:15.089044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-20e54ffd-18fd-4e81-b90f-df948e9c3104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:15.148063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:15.178511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 487/991] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:15.448874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552119ba-8dbd-42e9-a1f1-336bd8a8ddd8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:15.578355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552119ba-8dbd-42e9-a1f1-336bd8a8ddd8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:15.623563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3471d46-c69b-402f-b5b7-1c8f477d5a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:15.624287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471d46-c69b-402f-b5b7-1c8f477d5a79 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:15.624569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471d46-c69b-402f-b5b7-1c8f477d5a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:15.625085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3471d46-c69b-402f-b5b7-1c8f477d5a79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:15.625441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3471d46-c69b-402f-b5b7-1c8f477d5a79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:15.626844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3471d46-c69b-402f-b5b7-1c8f477d5a79 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-e3471d46-c69b-402f-b5b7-1c8f477d5a79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:15.642326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:15.643860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:15.646002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:15.648864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 505/992] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:15.650843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e54ffd-18fd-4e81-b90f-df948e9c3104 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:15.756304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2d69-014c-4350-b01e-043dd1a6cae1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:15.756605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2d69-014c-4350-b01e-043dd1a6cae1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:15.756821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2d69-014c-4350-b01e-043dd1a6cae1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:15.758149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 506/993] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:15.763411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397019f-c2ee-487e-bfc2-b0654ac6af36 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:15.763694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397019f-c2ee-487e-bfc2-b0654ac6af36 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:15.763968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397019f-c2ee-487e-bfc2-b0654ac6af36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:15.778824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e54ffd-18fd-4e81-b90f-df948e9c3104 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:15.786729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1397019f-c2ee-487e-bfc2-b0654ac6af36 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:15.787939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1397019f-c2ee-487e-bfc2-b0654ac6af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:15.829751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:15.830716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:15.831155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:15.831439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:15.832225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:15.832780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:15.835093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:15.844940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 488/994] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:48:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:15.852279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:15.858012 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:15.886144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 507/995] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:15.907090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:15.990419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b9ba0-8bf8-440d-93b8-fc573e5d94b5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.032271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:16.032490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.032650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.032920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.033554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:16.033856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:16.035224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:16.046452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 489/996] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:48:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:16.049656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397019f-c2ee-487e-bfc2-b0654ac6af36 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:16.161018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:16.177081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397019f-c2ee-487e-bfc2-b0654ac6af36 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.226975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2dd331-e541-4ab3-937c-8b32e53f8659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:16.227749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd331-e541-4ab3-937c-8b32e53f8659 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.228045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd331-e541-4ab3-937c-8b32e53f8659 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.228329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2dd331-e541-4ab3-937c-8b32e53f8659 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.229044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dd331-e541-4ab3-937c-8b32e53f8659 None admin] RBAC: Adding query filter params (interface=public, service_id=5f0e7ded70a64b348afc4033cea59280, region_id=RegionOne) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:16.229359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dd331-e541-4ab3-937c-8b32e53f8659 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:16.230740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2dd331-e541-4ab3-937c-8b32e53f8659 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:16.236680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 508/997] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:48:16 2022] GET /identity/v3/endpoints?service_id=5f0e7ded70a64b348afc4033cea59280&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:16.238036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957335-cfec-43c6-be7d-1fd97fc88dc7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.238326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957335-cfec-43c6-be7d-1fd97fc88dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.238602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957335-cfec-43c6-be7d-1fd97fc88dc7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.239904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 509/998] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:16.243376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957335-cfec-43c6-be7d-1fd97fc88dc7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:16.281596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0251d59-92c6-4b76-a47c-eeab0f376c4f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.290740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:16.303535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:16.331808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5114781-a5fa-4294-a1c8-df6b8ed8b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:16.332791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114781-a5fa-4294-a1c8-df6b8ed8b262 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.333205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114781-a5fa-4294-a1c8-df6b8ed8b262 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.333585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5114781-a5fa-4294-a1c8-df6b8ed8b262 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.334533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114781-a5fa-4294-a1c8-df6b8ed8b262 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:16.337038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5114781-a5fa-4294-a1c8-df6b8ed8b262 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b5114781-a5fa-4294-a1c8-df6b8ed8b262 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:16.347425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:16.348720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:16.349604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 490/999] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Sep 14 12:48:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:16.351124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aabb3-ab3b-40f5-8211-b6ccbdf65b8e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.351124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aabb3-ab3b-40f5-8211-b6ccbdf65b8e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.351124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aabb3-ab3b-40f5-8211-b6ccbdf65b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.359897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957335-cfec-43c6-be7d-1fd97fc88dc7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.370957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-371aabb3-ab3b-40f5-8211-b6ccbdf65b8e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:16.372204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-371aabb3-ab3b-40f5-8211-b6ccbdf65b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:16.396491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:16.397046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.397046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.398294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.398787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:16.400266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:16.407070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 510/1000] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:48:16 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:48:16.407905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:16.471125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 491/1001] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:16.535165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb38ec-3e23-4ac2-a03c-88c13c106ca4 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.553176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:16.578945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:16.579561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.579840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.580277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.580847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:16.581184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:16.582523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:16.589101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 511/1002] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:16.594708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aabb3-ab3b-40f5-8211-b6ccbdf65b8e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:16.758507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:16.762636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aabb3-ab3b-40f5-8211-b6ccbdf65b8e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.763495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:16.801638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:16.802298 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.802585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.802874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.803547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:16.803856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:16.805263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:16.810693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 492/1003] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Sep 14 12:48:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:16.816186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:16.893740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355abda2-1ae8-451e-9b17-5afb0a1b0e11 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.941132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:16.941768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:16.942099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:16.942310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] PATH_INFO: `/v3/services/image` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:16.942992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:16.947080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcd244-eceb-4a13-ba1d-04067bc5e76d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:16.947783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:16.963130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:16.968777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:16.970757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 512/1004] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Sep 14 12:48:16 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:16.972881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:17.000909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:17.001720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:17.002091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:17.002435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:17.003179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:17.004681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:17.029597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:17.036431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 493/1005] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:48:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:48:17.111617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d54d2c-0309-473f-bb06-e37aacdceb7e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:17.160504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6cdd-e6cb-4167-815b-8a0a9830cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:17.161129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6cdd-e6cb-4167-815b-8a0a9830cb4e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:17.161413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6cdd-e6cb-4167-815b-8a0a9830cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:17.161691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6cdd-e6cb-4167-815b-8a0a9830cb4e None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:17.162336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6cdd-e6cb-4167-815b-8a0a9830cb4e None admin] RBAC: Adding query filter params (name=image) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:17.162640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6cdd-e6cb-4167-815b-8a0a9830cb4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:17.165052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d6cdd-e6cb-4167-815b-8a0a9830cb4e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:17.170890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 513/1006] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:17.176759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:17.215818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:17.314934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac991d-45a6-440e-ae1d-93f753c3f2a9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:17.360668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc50bcd7-ca64-42b6-8ae4-7dda000b1b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:17.361299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bcd7-ca64-42b6-8ae4-7dda000b1b1f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:17.361581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bcd7-ca64-42b6-8ae4-7dda000b1b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:17.361898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc50bcd7-ca64-42b6-8ae4-7dda000b1b1f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:17.362474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bcd7-ca64-42b6-8ae4-7dda000b1b1f None admin] RBAC: Adding query filter params (type=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:17.362771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bcd7-ca64-42b6-8ae4-7dda000b1b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:17.364464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc50bcd7-ca64-42b6-8ae4-7dda000b1b1f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:17.371000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 494/1007] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:18.903911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24b49-1038-4528-8b48-fd8c459268cd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:18.904657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24b49-1038-4528-8b48-fd8c459268cd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:18.904657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24b49-1038-4528-8b48-fd8c459268cd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:18.906336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 514/1008] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:18.911987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8ba1a-1978-4389-a506-fab64f28c0d9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:18.912675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8ba1a-1978-4389-a506-fab64f28c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:18.912675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8ba1a-1978-4389-a506-fab64f28c0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:18.932532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f5e8ba1a-1978-4389-a506-fab64f28c0d9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:18.933730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f5e8ba1a-1978-4389-a506-fab64f28c0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:19.031877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 495/1009] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:18 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:19.306340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24b49-1038-4528-8b48-fd8c459268cd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:19.374921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67584c-b161-4c92-9365-33b0f8e4ff12 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:19.375268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67584c-b161-4c92-9365-33b0f8e4ff12 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:19.375469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67584c-b161-4c92-9365-33b0f8e4ff12 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:19.377868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 496/1010] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:19.385756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d845-f4a4-4adf-8d10-355c1b15f7ec None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:19.386656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d845-f4a4-4adf-8d10-355c1b15f7ec None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:19.386656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d845-f4a4-4adf-8d10-355c1b15f7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:19.408614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0045d845-f4a4-4adf-8d10-355c1b15f7ec None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:19.409819 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0045d845-f4a4-4adf-8d10-355c1b15f7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:19.427798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:19.447796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24b49-1038-4528-8b48-fd8c459268cd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:19.449425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:19.490562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741b004-ee84-48f7-89c4-73fa6b0e7a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:19.491891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b004-ee84-48f7-89c4-73fa6b0e7a68 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:19.492212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b004-ee84-48f7-89c4-73fa6b0e7a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:19.492488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741b004-ee84-48f7-89c4-73fa6b0e7a68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:19.493056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741b004-ee84-48f7-89c4-73fa6b0e7a68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:19.494412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741b004-ee84-48f7-89c4-73fa6b0e7a68 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:19.501184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 497/1011] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-5741b004-ee84-48f7-89c4-73fa6b0e7a68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:19.503685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:19.506345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 14 12:48:19.508851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:19.510826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 515/1012] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:19.512062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d845-f4a4-4adf-8d10-355c1b15f7ec None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:19.654521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d845-f4a4-4adf-8d10-355c1b15f7ec None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:19.709313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:19.711132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:19.711528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:19.711976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:19.713012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:19.713458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:19.715054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:19.720855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 498/1013] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:48:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:19.724920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972753a1-9004-4ff2-a932-5f3d565b5767 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:19.725589 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972753a1-9004-4ff2-a932-5f3d565b5767 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:19.725847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972753a1-9004-4ff2-a932-5f3d565b5767 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:19.727207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 516/1014] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:19.730102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:19.732686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caafb33-678c-4610-90ae-bcac84c98b29 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:19.732969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caafb33-678c-4610-90ae-bcac84c98b29 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:19.733238 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caafb33-678c-4610-90ae-bcac84c98b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:19.747518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:19.753518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4caafb33-678c-4610-90ae-bcac84c98b29 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:19.757259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4caafb33-678c-4610-90ae-bcac84c98b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:19.831787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 517/1015] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:19 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:19.832578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caafb33-678c-4610-90ae-bcac84c98b29 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:19.852052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9c7d8-c054-460c-a2f8-df29e9cc46e3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:19.893514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:19.894127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:19.894408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:19.894695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:19.895310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:19.895674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:19.897225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:19.909379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 499/1016] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Sep 14 12:48:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:19.911067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:19.956227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:19.963942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caafb33-678c-4610-90ae-bcac84c98b29 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:20.008901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:20.015285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:20.015933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:20.016242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:20.016518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:20.017659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:20.019098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:20.021373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 518/1017] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:20.026879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:20.040173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cadcda-9029-4a19-93d7-ea1b2d6acc7b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:20.083631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:20.084289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:20.084924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:20.085934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:20.086692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:20.090028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:20.116069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 500/1018] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:48:19 2022] POST /identity/v3/endpoints => generated 334 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:20.117308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:20.158695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577d1af-ce0b-4fc9-8fa6-2ca162bc4ecf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:20.211476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294af772-b150-4a69-8726-086aad0c22d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:20.212134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294af772-b150-4a69-8726-086aad0c22d6 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:20.212418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294af772-b150-4a69-8726-086aad0c22d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:20.212698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294af772-b150-4a69-8726-086aad0c22d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:20.213410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294af772-b150-4a69-8726-086aad0c22d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:20.214880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294af772-b150-4a69-8726-086aad0c22d6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:20.249218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 519/1019] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:48:20 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:48:20.265467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6c4d1-0ddc-4c41-ab19-af28bc6518e5 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:20.320216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:20.330348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433737c-dc94-4fcb-98e4-1a1eeb197af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:20.331432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433737c-dc94-4fcb-98e4-1a1eeb197af6 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:20.332457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433737c-dc94-4fcb-98e4-1a1eeb197af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:20.334187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433737c-dc94-4fcb-98e4-1a1eeb197af6 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:20.334422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433737c-dc94-4fcb-98e4-1a1eeb197af6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:20.337190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433737c-dc94-4fcb-98e4-1a1eeb197af6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:20.358001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 501/1020] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:48:20 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:22.618100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f082-7a44-492f-aaf0-3fd6e1cfac46 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:22.618545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f082-7a44-492f-aaf0-3fd6e1cfac46 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:22.618545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855f082-7a44-492f-aaf0-3fd6e1cfac46 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:22.620073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 520/1021] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:22.627631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4461-3aba-423b-a9d9-a8cb5891af88 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:22.629526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4461-3aba-423b-a9d9-a8cb5891af88 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:22.629526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed4461-3aba-423b-a9d9-a8cb5891af88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:22.650549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a2ed4461-3aba-423b-a9d9-a8cb5891af88 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:22.652353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a2ed4461-3aba-423b-a9d9-a8cb5891af88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:22.725001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd465c1-9a97-4e86-8451-9c907a66fdc5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:22.725386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd465c1-9a97-4e86-8451-9c907a66fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:22.725656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd465c1-9a97-4e86-8451-9c907a66fdc5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:22.727205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 521/1022] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:22.733061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b1af-89d0-4a21-a16b-673db1df832f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:22.733342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b1af-89d0-4a21-a16b-673db1df832f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:22.733611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b1af-89d0-4a21-a16b-673db1df832f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:22.744226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 502/1023] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:22.753512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f680b1af-89d0-4a21-a16b-673db1df832f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:22.754703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f680b1af-89d0-4a21-a16b-673db1df832f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:22.762236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805d2f-cf56-4ee1-8d4f-bdb4c9bdac9f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:22.762657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805d2f-cf56-4ee1-8d4f-bdb4c9bdac9f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:22.763149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16805d2f-cf56-4ee1-8d4f-bdb4c9bdac9f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:22.765099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:22.766158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 503/1024] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:22.771966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fedf97-0c7b-4308-830d-ad346d2eb288 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:22.772739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fedf97-0c7b-4308-830d-ad346d2eb288 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:22.773036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fedf97-0c7b-4308-830d-ad346d2eb288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:22.793268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f1fedf97-0c7b-4308-830d-ad346d2eb288 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:22.794490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f1fedf97-0c7b-4308-830d-ad346d2eb288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:22.845923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 522/1025] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:22.884214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 504/1026] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:23.032761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b1af-89d0-4a21-a16b-673db1df832f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.119497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fedf97-0c7b-4308-830d-ad346d2eb288 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.150482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b1af-89d0-4a21-a16b-673db1df832f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.184395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:23.208291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.208925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.209203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.210072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.226607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:23.232298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:23.233526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 523/1027] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:23.234714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.238702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:23.259263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fedf97-0c7b-4308-830d-ad346d2eb288 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.304481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.305232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.305510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.305779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.306926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:23.308399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:23.310053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 505/1028] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:23.310812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.350449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97694a53-58ec-464d-8804-c3323df12d08 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.388736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.389370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.389650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.389927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] PATH_INFO: `/v3/services/image` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.390543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:23.391914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:23.406495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:23.407736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:23.408710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:23.409853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 524/1029] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:23.410924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.431537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee10b87-e2b9-46a5-83e7-5890fd0ee11a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.450032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:23.472156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.473173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.473646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.474064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.475054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:23.475587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:23.477850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:23.486487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:23.492273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 506/1030] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:23.493502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.533336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1171b-c36d-4c77-9e77-389367134768 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.574302 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.574922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.575195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.575470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.576175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:23.577582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:23.602537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 525/1031] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:48:23 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:23.603171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.623073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bb43c-5135-4f79-aefb-4aa427a3f8f0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.668420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.669105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.669105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.669273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.669801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] RBAC: Adding query filter params (name=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:23.670106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:23.671566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:23.683104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 507/1032] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:23.684889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.737326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:23.748248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1912da4-168e-4bb4-a076-eb3b9682c9e8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.776046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:23.792445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.793224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.793504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.793773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.808440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:23.810325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:23.811856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3752-a5f4-4201-a0d9-ef337ca6b743 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:23.827544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:23.829190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:23.830192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:23.830192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:23.830192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:23.830192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 526/1033] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:23.834956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.865315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:23.866667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:23.867097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:23.868115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:23.868790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] RBAC: Adding query filter params (type=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:23.869098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:23.870523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:23.877359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 508/1034] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:23.884561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:23.964362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb434e-b760-4dee-8cd6-283b870dac01 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:24.008618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:24.008901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5370928b-3d9a-4f47-813d-c5d2e21c14ee None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:24.009281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:24.009559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:24.009832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:24.010482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:24.010780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:24.012179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:24.017880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:24.027580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 527/1035] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:24.032592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:24.055542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:24.056196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:24.056475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:24.056751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:24.057455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] RBAC: Adding query filter params (interface=public, service_id=71072be9cbb24973b881cd467598952a, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:24.057765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:24.059170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:24.074369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 509/1036] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:48:23 2022] GET /identity/v3/endpoints?service_id=71072be9cbb24973b881cd467598952a&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:24.075925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:24.085675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:24.174522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad41ad-2641-4552-81cb-b1fdb8b2c79e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:24.210066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d14e5d-3977-46b3-9be9-5bd2af4e790a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:24.222660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:24.223495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:24.223772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:24.224064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:24.232530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:24.233988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:48:24.247595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:24.249144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:24.250636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 528/1037] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:48:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:24.254867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:24.255422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:24.256078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:24.256429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:24.256700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:24.257467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:24.258864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:24.276048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 510/1038] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:48:24 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:48:24.387296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:24.396325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d7d44-b5d9-4bbf-99b5-fcbca1e9937c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:24.447107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:24.447734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:24.448003 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:24.448318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:24.449057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:24.449350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:24.451499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:24.474419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 529/1039] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:48:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:24.480589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:24.523301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:24.620548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c96c2-2613-4aa1-8230-57ae51df0b9f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:24.671064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:24.671709 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:24.671955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:24.672219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:24.748128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:24.749479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:24.801851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:24.888106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 511/1040] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:24 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:48:24.894317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:25.033433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc004fa-8907-40c4-9081-39f23e017f92 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:25.076842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:25.077491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:25.077767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:25.078039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:25.090161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:25.091630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:25.108028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:25.109075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:25.109985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:25.109985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:25.109985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:25.110792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 530/1041] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:25.115086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:25.239238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d63fdb-f876-4426-9d53-04586d286981 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:25.293877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:25.294595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:25.294998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:25.295405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:25.296238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:25.296668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:25.298258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:25.300061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:25.313282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 512/1042] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:25.320051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:25.327785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:25.466906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03a3c9-a047-4685-bf12-a07d85561d7d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:25.512425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:25.513067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:25.513345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:25.513624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:25.522565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:25.524086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:48:25.545467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:25.546447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:25.547534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:25.549123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 531/1043] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:25.552707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:25.696971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677b5c7-3fce-4b5a-9eb5-63a3701d152b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:25.746614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea7abc-6c9d-44ac-8ff8-d35db687faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:25.747249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea7abc-6c9d-44ac-8ff8-d35db687faf5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:25.747590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea7abc-6c9d-44ac-8ff8-d35db687faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:25.747866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea7abc-6c9d-44ac-8ff8-d35db687faf5 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:25.748627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea7abc-6c9d-44ac-8ff8-d35db687faf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:25.748929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea7abc-6c9d-44ac-8ff8-d35db687faf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:25.750413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea7abc-6c9d-44ac-8ff8-d35db687faf5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:25.768699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 513/1044] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:25.779503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:25.870493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:25.930388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eac5e2-4a4f-43c0-ac43-a499f5753158 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:25.984718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c1f54-5569-4f0d-800f-b172402e73b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:25.986492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1f54-5569-4f0d-800f-b172402e73b4 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:25.986492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1f54-5569-4f0d-800f-b172402e73b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:25.986940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1f54-5569-4f0d-800f-b172402e73b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:25.988370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c1f54-5569-4f0d-800f-b172402e73b4 None admin] RBAC: Adding query filter params (role.id=46e191bb5708421e98b22d384ea7ceb0, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=3faaacdf2ff54c06bb4eebf13533a72a) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:25.988892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c1f54-5569-4f0d-800f-b172402e73b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:25.991430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c1f54-5569-4f0d-800f-b172402e73b4 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:25.999228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 532/1045] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:25 2022] GET /identity/v3/role_assignments?user.id=3faaacdf2ff54c06bb4eebf13533a72a&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=46e191bb5708421e98b22d384ea7ceb0 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:26.188264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc7e2-1c35-43ac-9e8c-1bc96d8a97ea None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:26.188652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc7e2-1c35-43ac-9e8c-1bc96d8a97ea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:26.188835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fc7e2-1c35-43ac-9e8c-1bc96d8a97ea None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:26.190625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 514/1046] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:26.197510 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58016-27b4-4e47-bb15-52ac3db52486 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:26.197829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58016-27b4-4e47-bb15-52ac3db52486 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:26.198071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58016-27b4-4e47-bb15-52ac3db52486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:26.221714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0fe58016-27b4-4e47-bb15-52ac3db52486 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:26.222935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0fe58016-27b4-4e47-bb15-52ac3db52486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:26.303738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 533/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:26.592356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fc7e2-1c35-43ac-9e8c-1bc96d8a97ea None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:26.669854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:26.723440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fc7e2-1c35-43ac-9e8c-1bc96d8a97ea None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:26.726397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e9eb-7d3c-4e9f-8beb-f6e1e71eff50 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:26.726978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e9eb-7d3c-4e9f-8beb-f6e1e71eff50 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:26.727554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0e9eb-7d3c-4e9f-8beb-f6e1e71eff50 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:26.729201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 534/1048] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:26.736157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b416-a843-4ea8-b190-600aee7ec74d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:26.736483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b416-a843-4ea8-b190-600aee7ec74d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:26.736728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8b416-a843-4ea8-b190-600aee7ec74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:26.773427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-16d8b416-a843-4ea8-b190-600aee7ec74d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:26.775244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-16d8b416-a843-4ea8-b190-600aee7ec74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:26.788319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:26.790179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:26.790179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:26.790380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:26.812337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:26.822053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:26.823607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:26.824520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 515/1049] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:48:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:26.834985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:26.886583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:26.913705 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 535/1050] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:26.992772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0249-a194-4371-8e00-1359d30cccdd None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:27.008545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:27.050606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:27.051231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:27.051539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:27.051815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:27.052546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:27.052854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:27.055104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:27.065474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 516/1051] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:48:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:27.074599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b416-a843-4ea8-b190-600aee7ec74d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:27.249501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:27.256800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8b416-a843-4ea8-b190-600aee7ec74d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:27.330336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:27.331338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:27.331812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:27.332428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] PATH_INFO: `/v3/users/49e9408db0e5464680c358df1eb5b071` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:27.359845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] RBAC: Authorizing `identity:get_user(user_id=49e9408db0e5464680c358df1eb5b071)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:27.362368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:27.368068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 536/1052] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:27 2022] GET /identity/v3/users/49e9408db0e5464680c358df1eb5b071 => generated 285 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:27.371170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:27.374042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96477ce-da92-42e6-a2ae-ad7a342f1b6d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:27.427219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:27.436338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:27.437326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:27.437750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:27.438174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:27.438999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:27.441117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:27.456481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:27.457552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:27.461137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 517/1053] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Sep 14 12:48:27 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:27.465434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:27.503150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d4db8-6268-4427-9763-787e932e1d11 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:27.529961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:27.543594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:27.544329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:27.544545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:27.544823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:27.603419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4d90b-c03b-4701-ab18-0e945efff6c1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:27.648785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:27.650304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:27.655789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:27.656319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:27.656660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:27.656996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:27.657773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] RBAC: Adding query filter params (name=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:27.658145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:27.659834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:27.666603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 518/1054] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:27.672266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:27.717525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:27.810532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 537/1055] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:27 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 12:48:27.812774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:27.828370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951fe2e-9f63-4ed6-99c8-08020e97cc01 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:27.832964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:27.875333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:27.875948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:27.876255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:27.876531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:27.877163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] RBAC: Adding query filter params (type=image) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:27.877467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:27.878837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:27.884608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 519/1056] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:27.893112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:27.969599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15efc-091f-4d67-b364-90048b55ab73 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:28.012206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:28.013064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:28.014432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fb2ce-b024-4f36-9e7c-99a568a8e086 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:28.014583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:28.014583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:28.015579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] RBAC: Authorizing `identity:get_project(project_id=0d3f8942453d48419a8b99ced333e2a5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:28.017088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:28.019140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 538/1057] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:48:27 2022] GET /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5 => generated 311 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:28.025826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:28.042810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:28.058167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c1707-fcdb-4d70-9ab3-84ea4d49f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:28.058777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1707-fcdb-4d70-9ab3-84ea4d49f095 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:28.059216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1707-fcdb-4d70-9ab3-84ea4d49f095 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:28.059450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c1707-fcdb-4d70-9ab3-84ea4d49f095 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:28.060460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c1707-fcdb-4d70-9ab3-84ea4d49f095 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:28.061715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c1707-fcdb-4d70-9ab3-84ea4d49f095 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:28.085591 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 520/1058] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:48:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:48:28.148736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1489c9-c174-4939-b838-13e93302e36f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:28.203982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccb476-9d18-4937-84ea-a5e5acad7891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:28.204635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb476-9d18-4937-84ea-a5e5acad7891 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:28.204895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb476-9d18-4937-84ea-a5e5acad7891 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:28.205162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccb476-9d18-4937-84ea-a5e5acad7891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:28.205906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccb476-9d18-4937-84ea-a5e5acad7891 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=0d3f8942453d48419a8b99ced333e2a5, user.id=49e9408db0e5464680c358df1eb5b071) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:28.206207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccb476-9d18-4937-84ea-a5e5acad7891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:28.207680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccb476-9d18-4937-84ea-a5e5acad7891 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:28.216986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 539/1059] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:28 2022] GET /identity/v3/role_assignments?user.id=49e9408db0e5464680c358df1eb5b071&scope.project.id=0d3f8942453d48419a8b99ced333e2a5&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:28.581978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce381-feec-4322-a1e4-13e6134fff99 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:28.582307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce381-feec-4322-a1e4-13e6134fff99 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:28.582673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ce381-feec-4322-a1e4-13e6134fff99 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:28.584866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 521/1060] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:28.591244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3118ab-da0c-4ff9-96db-ba7d7180e08d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:28.591690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3118ab-da0c-4ff9-96db-ba7d7180e08d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:28.592171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3118ab-da0c-4ff9-96db-ba7d7180e08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:28.620742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-be3118ab-da0c-4ff9-96db-ba7d7180e08d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:28.622052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-be3118ab-da0c-4ff9-96db-ba7d7180e08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:28.744143 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 540/1061] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:29.058045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ce381-feec-4322-a1e4-13e6134fff99 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:29.091391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:29.182739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ce381-feec-4322-a1e4-13e6134fff99 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:29.219460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:29.220112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:29.220388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:29.220656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:29.231635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:29.236502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:29.237488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:29.238371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 522/1062] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Sep 14 12:48:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:29.245396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3118ab-da0c-4ff9-96db-ba7d7180e08d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:29.250741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:29.401992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3118ab-da0c-4ff9-96db-ba7d7180e08d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:29.443240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:29.444113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:29.444429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:29.444686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:29.445320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:29.445629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:29.447057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:29.456688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 541/1063] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Sep 14 12:48:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:29.463837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:29.567131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:29.586806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac9335-8026-4cab-9208-c4693841ccf4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:29.640604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:29.641575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:29.641575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:29.641924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:29.656524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:29.658219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:29.679900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:29.681630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:29.683099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:29.683099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:29.683099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:29.683099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 523/1064] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:29.688113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:29.775092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:29.821682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f15b40-391e-4d3b-9016-205c35b5fbf7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:29.863098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:29.863783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:29.864134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:29.864462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:29.865170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:29.866194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:29.868097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:29.888522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 542/1065] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:29.889714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:30.003585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b321a-2199-4bfa-8053-e54cdfe7fd13 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:30.041526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:30.042401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.042794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.043156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.046461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:30.054413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:30.055867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:48:30.067609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:30.069208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:30.070435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 524/1066] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:48:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:30.076911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:30.189033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a2383a-9e18-49a7-98c1-993c33bcac40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:30.216607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:30.227644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:30.228297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.228577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.228851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.229586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:30.229895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:30.231391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:30.254342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 543/1067] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:48:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:30.255243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:30.369372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4f335-81fc-495a-abda-d12d57fba032 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:30.420898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e22734-cc3a-4737-b236-97cd01e2bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:30.421584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22734-cc3a-4737-b236-97cd01e2bf19 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.421906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22734-cc3a-4737-b236-97cd01e2bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.422181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22734-cc3a-4737-b236-97cd01e2bf19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.436338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e22734-cc3a-4737-b236-97cd01e2bf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:30.437942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e22734-cc3a-4737-b236-97cd01e2bf19 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-18e22734-cc3a-4737-b236-97cd01e2bf19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:30.454504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:30.455607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:30.462316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:30.462316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:30.462316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:30.462316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 525/1068] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:30.462555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:30.474774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79442-1eb4-49f5-84fc-1d196ec68095 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.475983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79442-1eb4-49f5-84fc-1d196ec68095 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.476226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e79442-1eb4-49f5-84fc-1d196ec68095 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.477835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 526/1069] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:30.485967 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f1528-7b04-4e2a-8082-7de24d58897f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.486278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f1528-7b04-4e2a-8082-7de24d58897f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.486513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f1528-7b04-4e2a-8082-7de24d58897f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.506833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-428f1528-7b04-4e2a-8082-7de24d58897f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:30.508167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-428f1528-7b04-4e2a-8082-7de24d58897f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:30.558865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:30.585097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074b2f-8a74-4b02-beb5-2eaf19a1f7f3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:30.586683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 527/1070] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:30.588046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4202a-d362-4282-90dc-46c5308410aa None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.588293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4202a-d362-4282-90dc-46c5308410aa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.589297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4202a-d362-4282-90dc-46c5308410aa None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.592045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 528/1071] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:30.595720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8312c-9c75-4e8d-8031-355b3fed789f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.596003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8312c-9c75-4e8d-8031-355b3fed789f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.596302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8312c-9c75-4e8d-8031-355b3fed789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.617630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6ec8312c-9c75-4e8d-8031-355b3fed789f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:30.618908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6ec8312c-9c75-4e8d-8031-355b3fed789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:30.632283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:30.633236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.633516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.633796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.634450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:30.634759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:30.636195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:30.650656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 544/1072] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:30.656477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:30.711114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 529/1073] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:30.715716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:30.784812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79d85-ad4e-45c2-8d26-da8ae1bf5f2d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:30.821743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:30.822380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:30.822657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:30.822930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:30.830319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:30.831773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:48:30.845462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:30.846512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:30.847404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 545/1074] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:30.853097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8312c-9c75-4e8d-8031-355b3fed789f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:30.881864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:30.970482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8312c-9c75-4e8d-8031-355b3fed789f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:30.983549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:31.012623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f908ad0-32b9-499e-8500-df72a2eea827 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.015444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.015594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:31.015831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.015831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.016228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.016838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:31.017144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.018585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.037734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 530/1075] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:31.037734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:31.060215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.060826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.061111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.061381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.138666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.140149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.149103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ec597-b587-440c-a3bc-8196c658ad90 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.186015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.186651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.186931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.187204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.200986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:31.206522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:31.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:31.208480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 531/1076] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:48:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:31.209905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:31.244570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:31.259525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 546/1077] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 12:48:31.260411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:31.268338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:31.335727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f57294-190b-47c9-983b-e3408903ba78 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.383675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.384855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.385358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.385852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/3faaacdf2ff54c06bb4eebf13533a72a/roles/46e191bb5708421e98b22d384ea7ceb0` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.395134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=3faaacdf2ff54c06bb4eebf13533a72a, role_id=46e191bb5708421e98b22d384ea7ceb0)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.395134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.396517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137af27-a091-4554-9743-c7c5d83215ac None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.414154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 532/1078] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:48:31 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/3faaacdf2ff54c06bb4eebf13533a72a/roles/46e191bb5708421e98b22d384ea7ceb0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:48:31.414998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:31.456366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.457025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.457302 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.457962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.458262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:31.458567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.460749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.472311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 547/1079] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:48:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:31.480292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:31.547336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:31.564714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:31.565464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cfe95-d291-4841-b149-d92dd940a97e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.614343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81201c9-7686-4e44-be9c-b71e710be823 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.614938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.615623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.615998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.616594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.630885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.632715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:31.651782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:31.652845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:31.654079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:31.654079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:31.654079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:31.654079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 533/1080] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:31.659638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:31.667620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.668656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.669095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.669528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] PATH_INFO: `/v3/users/49e9408db0e5464680c358df1eb5b071` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.671367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] RBAC: Authorizing `identity:get_user(user_id=49e9408db0e5464680c358df1eb5b071)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.673907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.676424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 548/1081] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:31 2022] GET /identity/v3/users/49e9408db0e5464680c358df1eb5b071 => generated 285 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:31.686576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:31.810442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0074-38fb-4842-9095-3a7251568a2c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.828465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d14c1-5ac8-42bf-9b25-556272923f15 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:31.861345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.861953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.862231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.862616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.863153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:31.863464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.864927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.880210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421de2f-2279-4aa4-8877-97b5972fd8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:31.881629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:31.882089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421de2f-2279-4aa4-8877-97b5972fd8ee None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:31.882734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421de2f-2279-4aa4-8877-97b5972fd8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:31.883269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421de2f-2279-4aa4-8877-97b5972fd8ee None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:31.885926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421de2f-2279-4aa4-8877-97b5972fd8ee None admin] RBAC: Authorizing `identity:get_project(project_id=0d3f8942453d48419a8b99ced333e2a5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:31.887081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 534/1082] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:31.889312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421de2f-2279-4aa4-8877-97b5972fd8ee None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:31.891724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 549/1083] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:48:31 2022] GET /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5 => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:31.898706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:32.034921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca56e-b33b-4ac1-93a5-7f06663cccfc None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:32.078479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deaab25-38f5-4c1c-aa07-7bbd394ff898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:32.079149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaab25-38f5-4c1c-aa07-7bbd394ff898 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:32.079428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaab25-38f5-4c1c-aa07-7bbd394ff898 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:32.079698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deaab25-38f5-4c1c-aa07-7bbd394ff898 None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5/users/49e9408db0e5464680c358df1eb5b071/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:32.081870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaab25-38f5-4c1c-aa07-7bbd394ff898 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d3f8942453d48419a8b99ced333e2a5, user_id=49e9408db0e5464680c358df1eb5b071, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:32.083628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deaab25-38f5-4c1c-aa07-7bbd394ff898 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:32.100797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 535/1084] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:48:31 2022] PUT /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5/users/49e9408db0e5464680c358df1eb5b071/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:48:33.764973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e175-0fbe-44b1-8292-e37791aa1e81 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:33.765896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e175-0fbe-44b1-8292-e37791aa1e81 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:33.766358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908e175-0fbe-44b1-8292-e37791aa1e81 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:33.768881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 550/1085] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:33.778888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc439-4768-4a92-a60e-4c66beb25f5e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:33.779441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc439-4768-4a92-a60e-4c66beb25f5e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:33.779798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc439-4768-4a92-a60e-4c66beb25f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:33.811844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-940dc439-4768-4a92-a60e-4c66beb25f5e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:33.813840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-940dc439-4768-4a92-a60e-4c66beb25f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:33.883989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:33.897865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 536/1086] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:34.191023 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908e175-0fbe-44b1-8292-e37791aa1e81 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:34.196734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:34.346839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908e175-0fbe-44b1-8292-e37791aa1e81 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:34.385227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada1f08-c571-4e1e-9342-2b2a37feea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:34.385876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1f08-c571-4e1e-9342-2b2a37feea6a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:34.386154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1f08-c571-4e1e-9342-2b2a37feea6a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:34.386427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada1f08-c571-4e1e-9342-2b2a37feea6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:34.399171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada1f08-c571-4e1e-9342-2b2a37feea6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4ada1f08-c571-4e1e-9342-2b2a37feea6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:34.404721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:34.405879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:34.407603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 551/1087] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Sep 14 12:48:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:48:34.412575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dc439-4768-4a92-a60e-4c66beb25f5e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:34.420576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b25c-6029-4009-a418-bd378fba56cd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:34.420872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b25c-6029-4009-a418-bd378fba56cd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:34.421136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879b25c-6029-4009-a418-bd378fba56cd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:34.422848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 552/1088] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:34.429221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538074e7-56f5-402e-9842-d7524061e9cd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:34.429506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538074e7-56f5-402e-9842-d7524061e9cd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:34.429765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538074e7-56f5-402e-9842-d7524061e9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:34.452707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-538074e7-56f5-402e-9842-d7524061e9cd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:34.454452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-538074e7-56f5-402e-9842-d7524061e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:34.529439 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:34.541616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 553/1089] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:34.544118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dc439-4768-4a92-a60e-4c66beb25f5e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:34.600949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:34.601873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:34.601873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:34.602898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:34.602898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:34.603694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:34.604446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:34.614003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 537/1090] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Sep 14 12:48:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:34.619926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538074e7-56f5-402e-9842-d7524061e9cd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:34.773875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538074e7-56f5-402e-9842-d7524061e9cd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:34.825602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:34.826920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:34.827597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:34.828050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:34.828449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:34.843587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:34.845685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:34.869511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:34.870951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:34.872780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:34.872780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:34.872780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:34.872780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 554/1091] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:34.878371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:34.917419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:34.969563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:34.995006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce356f-2e70-434c-b3e7-7dc9f0a41572 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.043018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.043957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.044330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.044609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.057494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:35.059974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03ed4a-256c-46d1-aecf-0f26ee5991f6 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:35.062396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:35.064127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:35.065912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 538/1092] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:48:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:35.073638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:35.109698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.110640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.111107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.111570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.112544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:35.113040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:35.115424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:35.132244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 555/1093] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:35.138657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:35.204100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af47cda-49bc-41ee-b0cd-b4d7c694ee3b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.218616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:35.244720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.245354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.245632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.245905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.246585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:35.246891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:35.248356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:35.258507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 539/1094] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:48:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:35.259780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3cc41-76f0-46b8-b4c4-7632eaaf8b56 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.263621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:35.265536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:35.306928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.307664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.308138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.308574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.321998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:35.325353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:48:35.343740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:35.345120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:35.347128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 556/1095] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Sep 14 12:48:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:35.353093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:35.438984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855fcae-a24c-4d47-a606-a491a0083763 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.497576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.498573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.498927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.499350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] PATH_INFO: `/v3/users/49e9408db0e5464680c358df1eb5b071` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.501425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] RBAC: Authorizing `identity:get_user(user_id=49e9408db0e5464680c358df1eb5b071)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:35.503823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:35.506920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 540/1096] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:35 2022] GET /identity/v3/users/49e9408db0e5464680c358df1eb5b071 => generated 285 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:35.515645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:35.536547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86810bb-33b4-48c1-a773-1385b2c0a733 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.573578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:35.582089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.582897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.583276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.583737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.585881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:35.586200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:35.587726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:35.610800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 557/1097] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Sep 14 12:48:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:35.617851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:35.649482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:35.651607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de78491-268f-418d-a1d0-42d662aff480 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.696441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.697073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.697350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.697619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.751654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e568bbf-f0af-4d3e-897a-ba6adfd2d720 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:35.796420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:35.797565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:35.797829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:35.798262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:35.801418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:35.804219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:35.880475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:35.916658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:35.919194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:35.962245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:35.971139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 541/1098] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 12:48:35.979313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:36.103452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 558/1099] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:48:36.110852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:36.116639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fea777-f892-4f1e-9f28-2a8453578749 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:36.182596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:36.183290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:36.183651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:36.184007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:36.185574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] RBAC: Authorizing `identity:get_project(project_id=0d3f8942453d48419a8b99ced333e2a5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:36.188260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:36.191334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 542/1100] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:48:35 2022] GET /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:36.203381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:36.229171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:36.302163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636da01b-6f38-4afa-a298-86a706520872 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:36.335264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:36.352007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:36.352723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:36.353002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:36.353276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:36.365339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:36.367314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:48:36.386398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:36.389968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:48:36.391787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:48:36.391787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:48:36.391787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:36.391787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 559/1101] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:36.395305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:36.416681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e1575-a971-4fd0-b1f7-fd6c3ebd0995 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:36.464431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:36.465027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:36.465304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:36.465570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:36.466305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=0d3f8942453d48419a8b99ced333e2a5, user.id=49e9408db0e5464680c358df1eb5b071) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:36.466607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:36.468352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:36.477126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 543/1102] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:36 2022] GET /identity/v3/role_assignments?user.id=49e9408db0e5464680c358df1eb5b071&scope.project.id=0d3f8942453d48419a8b99ced333e2a5&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:36.531231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7759de-5f56-47df-814b-059c0e2b36b8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:36.580227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:36.581239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:36.581715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:36.582196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:36.583333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:36.583862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:36.587000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:36.624404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 560/1103] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:36.625823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:36.729107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:36.773545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe20a79-5be8-4974-a16f-7387be731338 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:36.828682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:36.829310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:36.829883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:36.829883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:36.837908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:36.839378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:48:36.853662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:36.854678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:48:36.855611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 544/1104] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:48:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:36.860972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:36.900478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:36.976035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab0367-586a-4ce8-8405-eb47b1bb7e59 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:37.023521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e2ad9-7228-4229-912f-1c2c082f74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:37.024075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e2ad9-7228-4229-912f-1c2c082f74e1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:37.024357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e2ad9-7228-4229-912f-1c2c082f74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:37.024629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e2ad9-7228-4229-912f-1c2c082f74e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:37.025336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e2ad9-7228-4229-912f-1c2c082f74e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:37.025643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e2ad9-7228-4229-912f-1c2c082f74e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:37.027357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e2ad9-7228-4229-912f-1c2c082f74e1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:37.042044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 561/1105] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:37.048652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:37.156368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1ef2-7008-4c75-8483-320e3d95073f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:37.191378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838cc11-a48a-4a89-b670-f496306dc515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:37.192241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cc11-a48a-4a89-b670-f496306dc515 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:37.192605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cc11-a48a-4a89-b670-f496306dc515 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:37.192999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cc11-a48a-4a89-b670-f496306dc515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:37.194735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838cc11-a48a-4a89-b670-f496306dc515 None admin] RBAC: Adding query filter params (role.id=46e191bb5708421e98b22d384ea7ceb0, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=3faaacdf2ff54c06bb4eebf13533a72a) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:37.195211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838cc11-a48a-4a89-b670-f496306dc515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:37.196832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838cc11-a48a-4a89-b670-f496306dc515 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:37.199127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:37.204199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 545/1106] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:37 2022] GET /identity/v3/role_assignments?user.id=3faaacdf2ff54c06bb4eebf13533a72a&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=46e191bb5708421e98b22d384ea7ceb0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:38.837566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c39db-96bb-4506-9881-bf8569ddbb55 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:38.838111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c39db-96bb-4506-9881-bf8569ddbb55 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:38.838111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c39db-96bb-4506-9881-bf8569ddbb55 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:38.839404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 562/1107] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:38.844926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0ede-c727-4d17-9126-147774789b94 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:38.845324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0ede-c727-4d17-9126-147774789b94 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:38.845459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d0ede-c727-4d17-9126-147774789b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:38.863912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d58d0ede-c727-4d17-9126-147774789b94 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:38.865704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d58d0ede-c727-4d17-9126-147774789b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:38.932558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 546/1108] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:39.209994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c39db-96bb-4506-9881-bf8569ddbb55 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:39.305188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:39.312926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c39db-96bb-4506-9881-bf8569ddbb55 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:39.346036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadc8c3-41e4-481e-a8e6-4e7f7394f083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:39.346653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc8c3-41e4-481e-a8e6-4e7f7394f083 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:39.346988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc8c3-41e4-481e-a8e6-4e7f7394f083 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:39.347203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadc8c3-41e4-481e-a8e6-4e7f7394f083 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:39.348337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc8c3-41e4-481e-a8e6-4e7f7394f083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:39.350403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadc8c3-41e4-481e-a8e6-4e7f7394f083 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:39.351989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 563/1109] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:39.362303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d0ede-c727-4d17-9126-147774789b94 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:39.466405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d0ede-c727-4d17-9126-147774789b94 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:39.494268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:39.502495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c0c1c-96cf-4d2f-a6dd-c5667f2d3e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:39.503092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0c1c-96cf-4d2f-a6dd-c5667f2d3e36 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:39.503365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0c1c-96cf-4d2f-a6dd-c5667f2d3e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:39.503633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0c1c-96cf-4d2f-a6dd-c5667f2d3e36 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:39.504314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c0c1c-96cf-4d2f-a6dd-c5667f2d3e36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:39.505796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c0c1c-96cf-4d2f-a6dd-c5667f2d3e36 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:39.536283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 547/1110] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:48:39 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:48:41.768654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d440f-5ae8-4daf-ab73-1ab0960fc2fb None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:41.769179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d440f-5ae8-4daf-ab73-1ab0960fc2fb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:41.769179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d440f-5ae8-4daf-ab73-1ab0960fc2fb None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:41.770507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 564/1111] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:41.776284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae2d6-b5f0-4360-a347-2832a67fe6da None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:41.776755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae2d6-b5f0-4360-a347-2832a67fe6da None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:41.776858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae2d6-b5f0-4360-a347-2832a67fe6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:41.795605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-051ae2d6-b5f0-4360-a347-2832a67fe6da None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:41.796800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-051ae2d6-b5f0-4360-a347-2832a67fe6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:41.867136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 548/1112] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:42.134600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d440f-5ae8-4daf-ab73-1ab0960fc2fb None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:42.243619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d440f-5ae8-4daf-ab73-1ab0960fc2fb None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:42.280120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:42.280746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:42.281021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:42.281293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] PATH_INFO: `/v3/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:42.282692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] RBAC: Authorizing `identity:get_role(role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:42.284081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:42.285401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 565/1113] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:42 2022] GET /identity/v3/roles/e02cd49dfc6343ce87700207db79ff78 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:42.292214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ae2d6-b5f0-4360-a347-2832a67fe6da None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:42.397180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ae2d6-b5f0-4360-a347-2832a67fe6da None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:42.412614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:42.435597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:42.436264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:42.436541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:42.436840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] PATH_INFO: `/v3/users/7dcf37d99de54a0c9c4b98dd2d4c18d1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:42.450402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] RBAC: Authorizing `identity:get_user(user_id=7dcf37d99de54a0c9c4b98dd2d4c18d1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:42.451838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:42.453474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 549/1114] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:42 2022] GET /identity/v3/users/7dcf37d99de54a0c9c4b98dd2d4c18d1 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:42.459534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:42.491430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:42.564419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503557fd-7234-403a-8f18-0c9e7ce5ddc8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:42.597731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:42.598339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:42.598618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:42.598889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:42.669345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:42.670700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:42.700766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:42.772731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 566/1115] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:48:42.779081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:42.887455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b92ae5-b675-475d-9e3d-e7e568ee4682 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:42.922066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478b068-8901-4d28-b1be-8aaa0dd98b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:42.922681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478b068-8901-4d28-b1be-8aaa0dd98b78 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:42.922905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478b068-8901-4d28-b1be-8aaa0dd98b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:42.923144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478b068-8901-4d28-b1be-8aaa0dd98b78 None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:42.924271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478b068-8901-4d28-b1be-8aaa0dd98b78 None admin] RBAC: Authorizing `identity:get_project(project_id=0d3f8942453d48419a8b99ced333e2a5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:42.925693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478b068-8901-4d28-b1be-8aaa0dd98b78 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:42.927287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 550/1116] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:48:42 2022] GET /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:42.934904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:43.034685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b347aa-6585-4e8f-b2b8-c6d9bdf066ff None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:43.066733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:43.073237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac695b1-9b4c-41e8-b4d7-71beb86fcfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:43.074028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac695b1-9b4c-41e8-b4d7-71beb86fcfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:43.074311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac695b1-9b4c-41e8-b4d7-71beb86fcfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:43.074587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac695b1-9b4c-41e8-b4d7-71beb86fcfd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:43.075312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac695b1-9b4c-41e8-b4d7-71beb86fcfd8 None admin] RBAC: Adding query filter params (role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=0d3f8942453d48419a8b99ced333e2a5, user.id=7dcf37d99de54a0c9c4b98dd2d4c18d1) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:43.075620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac695b1-9b4c-41e8-b4d7-71beb86fcfd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:43.077072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac695b1-9b4c-41e8-b4d7-71beb86fcfd8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:43.082724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 567/1117] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:42 2022] GET /identity/v3/role_assignments?user.id=7dcf37d99de54a0c9c4b98dd2d4c18d1&scope.project.id=0d3f8942453d48419a8b99ced333e2a5&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:45.238484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f157bb-33ff-4f96-851c-633529e3b5da None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:45.239053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f157bb-33ff-4f96-851c-633529e3b5da None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:45.239053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f157bb-33ff-4f96-851c-633529e3b5da None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:45.240701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 551/1118] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:45.245941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c426d3e-2a27-42da-9f54-6e396c0e6f68 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:45.246366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c426d3e-2a27-42da-9f54-6e396c0e6f68 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:45.246476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c426d3e-2a27-42da-9f54-6e396c0e6f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:45.264480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8c426d3e-2a27-42da-9f54-6e396c0e6f68 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:45.265678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c426d3e-2a27-42da-9f54-6e396c0e6f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:45.332659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 568/1119] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:45.614809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f157bb-33ff-4f96-851c-633529e3b5da None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:45.659933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:45.720512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f157bb-33ff-4f96-851c-633529e3b5da None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:45.758687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:45.759330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:45.759603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:45.759874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] PATH_INFO: `/v3/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:45.761307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] RBAC: Authorizing `identity:get_role(role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:45.762674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:45.763998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 552/1120] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:45 2022] GET /identity/v3/roles/e02cd49dfc6343ce87700207db79ff78 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:45.770063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c426d3e-2a27-42da-9f54-6e396c0e6f68 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:45.881832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c426d3e-2a27-42da-9f54-6e396c0e6f68 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:45.907537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:45.919736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:45.920409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:45.920690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:45.920965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] PATH_INFO: `/v3/users/7dcf37d99de54a0c9c4b98dd2d4c18d1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:45.922087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] RBAC: Authorizing `identity:get_user(user_id=7dcf37d99de54a0c9c4b98dd2d4c18d1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:45.923519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:45.925136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 569/1121] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:45 2022] GET /identity/v3/users/7dcf37d99de54a0c9c4b98dd2d4c18d1 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:45.931714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:46.032115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1df6a-efa0-46d3-9eea-3c1b385c203f None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:46.043017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:46.068142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36f38f-323c-42b0-a328-0544b8761301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:46.068762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36f38f-323c-42b0-a328-0544b8761301 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:46.069037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36f38f-323c-42b0-a328-0544b8761301 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:46.069306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36f38f-323c-42b0-a328-0544b8761301 None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:46.070410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36f38f-323c-42b0-a328-0544b8761301 None admin] RBAC: Authorizing `identity:get_project(project_id=0d3f8942453d48419a8b99ced333e2a5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:46.071823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36f38f-323c-42b0-a328-0544b8761301 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:46.073458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 553/1122] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:48:45 2022] GET /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:46.079451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:46.182170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607d94-ef4b-4287-933c-bda8bed5e689 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:46.216951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa313799-d4e3-4e0d-a8ec-bd266bbe4b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:46.217606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa313799-d4e3-4e0d-a8ec-bd266bbe4b38 None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:46.217880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa313799-d4e3-4e0d-a8ec-bd266bbe4b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:46.218144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa313799-d4e3-4e0d-a8ec-bd266bbe4b38 None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5/users/7dcf37d99de54a0c9c4b98dd2d4c18d1/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:46.220271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa313799-d4e3-4e0d-a8ec-bd266bbe4b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d3f8942453d48419a8b99ced333e2a5, user_id=7dcf37d99de54a0c9c4b98dd2d4c18d1, role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:46.221676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa313799-d4e3-4e0d-a8ec-bd266bbe4b38 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:46.235345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 570/1123] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:48:46 2022] PUT /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5/users/7dcf37d99de54a0c9c4b98dd2d4c18d1/roles/e02cd49dfc6343ce87700207db79ff78 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:48:48.464963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde35ef2-8acb-4078-9cb8-26560eea22d4 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:48.465503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde35ef2-8acb-4078-9cb8-26560eea22d4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:48.465503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde35ef2-8acb-4078-9cb8-26560eea22d4 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:48.466822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 554/1124] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:48.472118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599e756-68a3-4475-bc3d-c53358c602ee None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:48.472544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599e756-68a3-4475-bc3d-c53358c602ee None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:48.472709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599e756-68a3-4475-bc3d-c53358c602ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:48.492558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0599e756-68a3-4475-bc3d-c53358c602ee None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:48.493759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0599e756-68a3-4475-bc3d-c53358c602ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:48.554709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:48.577558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 571/1125] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:48.859799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde35ef2-8acb-4078-9cb8-26560eea22d4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:48.972040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde35ef2-8acb-4078-9cb8-26560eea22d4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:49.016341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:49.016980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:49.017269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:49.017541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] PATH_INFO: `/v3/roles/e02cd49dfc6343ce87700207db79ff78` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:49.018940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] RBAC: Authorizing `identity:get_role(role_id=e02cd49dfc6343ce87700207db79ff78)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:49.020338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:49.021683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 555/1126] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:48 2022] GET /identity/v3/roles/e02cd49dfc6343ce87700207db79ff78 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:49.027892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599e756-68a3-4475-bc3d-c53358c602ee None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:49.141741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599e756-68a3-4475-bc3d-c53358c602ee None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:49.179015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:49.179648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:49.179926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:49.180225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] PATH_INFO: `/v3/users/7dcf37d99de54a0c9c4b98dd2d4c18d1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:49.181351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] RBAC: Authorizing `identity:get_user(user_id=7dcf37d99de54a0c9c4b98dd2d4c18d1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:49.182773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:49.184390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 572/1127] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:49 2022] GET /identity/v3/users/7dcf37d99de54a0c9c4b98dd2d4c18d1 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:49.190201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:49.246007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:49.304315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05b221-e527-4f6f-9f58-0232ee52cf8c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:49.340793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:49.341405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:49.341684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:49.341956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:49.422855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:49.424261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:49.470970 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:49.529481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 556/1128] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:48:49.535499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:49.587482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:49.638851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbe2ad-1c1d-4302-8cb7-c6cd11bc9c94 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:49.673519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d5c25-8275-4fea-a3a1-b1073ad64f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:49.674080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5c25-8275-4fea-a3a1-b1073ad64f27 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:49.674354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5c25-8275-4fea-a3a1-b1073ad64f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:49.674621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d5c25-8275-4fea-a3a1-b1073ad64f27 None admin] PATH_INFO: `/v3/projects/0d3f8942453d48419a8b99ced333e2a5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:49.675834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d5c25-8275-4fea-a3a1-b1073ad64f27 None admin] RBAC: Authorizing `identity:get_project(project_id=0d3f8942453d48419a8b99ced333e2a5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:49.677787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d5c25-8275-4fea-a3a1-b1073ad64f27 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:49.679500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 573/1129] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:48:49 2022] GET /identity/v3/projects/0d3f8942453d48419a8b99ced333e2a5 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:49.685706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:49.787588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886efc8-36d2-4a5d-ac7f-20b21faa8e65 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:49.824112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09329da-f069-4cae-914b-e15099cd6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:49.824746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09329da-f069-4cae-914b-e15099cd6396 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:49.825028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09329da-f069-4cae-914b-e15099cd6396 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:49.825304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09329da-f069-4cae-914b-e15099cd6396 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:49.826027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09329da-f069-4cae-914b-e15099cd6396 None admin] RBAC: Adding query filter params (role.id=e02cd49dfc6343ce87700207db79ff78, scope.project.id=0d3f8942453d48419a8b99ced333e2a5, user.id=7dcf37d99de54a0c9c4b98dd2d4c18d1) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:49.826336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09329da-f069-4cae-914b-e15099cd6396 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:49.827765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09329da-f069-4cae-914b-e15099cd6396 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:49.833957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 557/1130] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:49 2022] GET /identity/v3/role_assignments?user.id=7dcf37d99de54a0c9c4b98dd2d4c18d1&scope.project.id=0d3f8942453d48419a8b99ced333e2a5&role.id=e02cd49dfc6343ce87700207db79ff78 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:52.085427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66724253-b7e3-4e0c-85e1-c082eafdecb4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:52.086209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66724253-b7e3-4e0c-85e1-c082eafdecb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:52.086209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66724253-b7e3-4e0c-85e1-c082eafdecb4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:52.087980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 574/1131] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:52.093814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f978e93-e58b-4ac0-a0e4-43bda59be2a4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:52.094368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f978e93-e58b-4ac0-a0e4-43bda59be2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:52.094368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f978e93-e58b-4ac0-a0e4-43bda59be2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:52.113810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3f978e93-e58b-4ac0-a0e4-43bda59be2a4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:52.115637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3f978e93-e58b-4ac0-a0e4-43bda59be2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:52.117929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:52.186759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 558/1132] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:52.461451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66724253-b7e3-4e0c-85e1-c082eafdecb4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:52.581991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66724253-b7e3-4e0c-85e1-c082eafdecb4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:52.615952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:52.643040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7689b5-6b6a-41ac-8013-600284fdddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:52.644114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7689b5-6b6a-41ac-8013-600284fdddf8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:52.644651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7689b5-6b6a-41ac-8013-600284fdddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:52.645097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7689b5-6b6a-41ac-8013-600284fdddf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:52.647591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7689b5-6b6a-41ac-8013-600284fdddf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:52.650115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7689b5-6b6a-41ac-8013-600284fdddf8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:52.653260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 575/1133] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:52.659024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f978e93-e58b-4ac0-a0e4-43bda59be2a4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:52.772677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f978e93-e58b-4ac0-a0e4-43bda59be2a4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:52.816454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068fbc9-fb85-49a6-b8a5-f3e0fe0d62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:52.817065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068fbc9-fb85-49a6-b8a5-f3e0fe0d62cd None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:52.817336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068fbc9-fb85-49a6-b8a5-f3e0fe0d62cd None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:52.818285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068fbc9-fb85-49a6-b8a5-f3e0fe0d62cd None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:52.819327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068fbc9-fb85-49a6-b8a5-f3e0fe0d62cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:52.820892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068fbc9-fb85-49a6-b8a5-f3e0fe0d62cd None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:52.830780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:52.849463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 559/1134] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:48:52 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:55.123288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510629e1-d1d3-481a-bcd1-f18ef91e4583 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:55.123843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510629e1-d1d3-481a-bcd1-f18ef91e4583 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:55.123843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510629e1-d1d3-481a-bcd1-f18ef91e4583 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:55.125178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 576/1135] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:48:55.132858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0868c-e0d6-46fd-9fd2-0410fa7aafd8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:55.133412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0868c-e0d6-46fd-9fd2-0410fa7aafd8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:55.133412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0868c-e0d6-46fd-9fd2-0410fa7aafd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:55.155425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b4f0868c-e0d6-46fd-9fd2-0410fa7aafd8 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:55.156686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b4f0868c-e0d6-46fd-9fd2-0410fa7aafd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:55.233901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 560/1136] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:48:55.514353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510629e1-d1d3-481a-bcd1-f18ef91e4583 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:55.643181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510629e1-d1d3-481a-bcd1-f18ef91e4583 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:55.693759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5b14c-406c-4441-a395-987c8d50b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:55.694454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b14c-406c-4441-a395-987c8d50b372 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:55.694774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b14c-406c-4441-a395-987c8d50b372 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:55.695083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5b14c-406c-4441-a395-987c8d50b372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:55.696318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5b14c-406c-4441-a395-987c8d50b372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:55.697783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5b14c-406c-4441-a395-987c8d50b372 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:55.699389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 577/1137] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:48:55.705272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0868c-e0d6-46fd-9fd2-0410fa7aafd8 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:55.817025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0868c-e0d6-46fd-9fd2-0410fa7aafd8 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:55.842159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:55.858888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96885d42-63f3-47eb-b7a6-a9e75b053742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:55.859510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96885d42-63f3-47eb-b7a6-a9e75b053742 None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:55.859790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96885d42-63f3-47eb-b7a6-a9e75b053742 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:55.860089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96885d42-63f3-47eb-b7a6-a9e75b053742 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:55.860771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96885d42-63f3-47eb-b7a6-a9e75b053742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:55.862252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96885d42-63f3-47eb-b7a6-a9e75b053742 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:55.886609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 561/1138] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:48:55 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:48:58.302927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e531c9-d734-43e7-85a2-cbff4cc17b2b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:58.303544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e531c9-d734-43e7-85a2-cbff4cc17b2b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:58.303544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e531c9-d734-43e7-85a2-cbff4cc17b2b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:58.304824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 578/1139] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:48:58.310704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1a74-9537-4f81-a49e-1a331f72f896 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:58.311245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1a74-9537-4f81-a49e-1a331f72f896 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:58.311245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc1a74-9537-4f81-a49e-1a331f72f896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:58.331387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4cdc1a74-9537-4f81-a49e-1a331f72f896 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:48:58.332597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4cdc1a74-9537-4f81-a49e-1a331f72f896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:48:58.413662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 562/1140] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:48:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:48:58.696053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e531c9-d734-43e7-85a2-cbff4cc17b2b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:58.767393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:58.818744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e531c9-d734-43e7-85a2-cbff4cc17b2b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:58.854121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:58.854765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:58.855038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:58.855306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:58.870170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:48:58.875460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:48:58.876753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:48:58.878362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 579/1141] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:48:58.884815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1a74-9537-4f81-a49e-1a331f72f896 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:59.002307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc1a74-9537-4f81-a49e-1a331f72f896 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:59.012144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:59.045701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:59.046323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:59.046610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:59.046886 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:59.047559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:48:59.047869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:59.049287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:59.058431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 563/1142] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:59.064973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:59.189109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07eb1e2-2d35-4f96-a115-e772d7774e1a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:59.212654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:59.235096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:59.235733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:59.236009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:59.236310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] PATH_INFO: `/v3/users/bb8a330db3a14597a11bd4648c5cce18` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:59.251854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] RBAC: Authorizing `identity:get_user(user_id=bb8a330db3a14597a11bd4648c5cce18)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:59.253320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:59.255606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 580/1143] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:48:59 2022] GET /identity/v3/users/bb8a330db3a14597a11bd4648c5cce18 => generated 286 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:59.262065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:59.388847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db0c5c-daeb-490c-b6fb-f4cc34e21492 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:59.434385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:59.435000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:59.435273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:59.435738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:59.482187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:48:59.531162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:59.532602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:59.673015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 564/1144] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:48:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:48:59.681052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:59.815210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8bae0-798f-404d-b98b-5bb22daef182 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:48:59.868749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c081ee7-7562-454b-a0f3-f58cbef56f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:48:59.869809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081ee7-7562-454b-a0f3-f58cbef56f91 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:48:59.870086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081ee7-7562-454b-a0f3-f58cbef56f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:48:59.870358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c081ee7-7562-454b-a0f3-f58cbef56f91 None admin] PATH_INFO: `/v3/projects/8ca100f29a7b4a589f001e76e4d07baf` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:48:59.871501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c081ee7-7562-454b-a0f3-f58cbef56f91 None admin] RBAC: Authorizing `identity:get_project(project_id=8ca100f29a7b4a589f001e76e4d07baf)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:48:59.872982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c081ee7-7562-454b-a0f3-f58cbef56f91 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:48:59.874755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 581/1145] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:48:59 2022] GET /identity/v3/projects/8ca100f29a7b4a589f001e76e4d07baf => generated 311 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:48:59.882800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:48:59.961196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:00.020985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb4014-f14e-4350-98c6-d18fbeb1d089 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:00.072590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa30e5-98fe-4964-8214-8190950e1e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:00.073550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa30e5-98fe-4964-8214-8190950e1e35 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:00.074025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa30e5-98fe-4964-8214-8190950e1e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:00.074494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa30e5-98fe-4964-8214-8190950e1e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:00.076490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa30e5-98fe-4964-8214-8190950e1e35 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=8ca100f29a7b4a589f001e76e4d07baf, user.id=bb8a330db3a14597a11bd4648c5cce18) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:00.077051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa30e5-98fe-4964-8214-8190950e1e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:00.080482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa30e5-98fe-4964-8214-8190950e1e35 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:00.090996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 565/1146] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:48:59 2022] GET /identity/v3/role_assignments?user.id=bb8a330db3a14597a11bd4648c5cce18&scope.project.id=8ca100f29a7b4a589f001e76e4d07baf&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:02.558887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf6177-8a46-4e6d-be04-ce822857daba None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:02.559497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf6177-8a46-4e6d-be04-ce822857daba None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:02.559746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf6177-8a46-4e6d-be04-ce822857daba None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:02.561954 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 582/1147] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:02.568284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b432-ea6c-4540-a804-f52d7c0725b9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:02.569001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b432-ea6c-4540-a804-f52d7c0725b9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:02.569001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b432-ea6c-4540-a804-f52d7c0725b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:02.591058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a6b6b432-ea6c-4540-a804-f52d7c0725b9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:02.592278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6b6b432-ea6c-4540-a804-f52d7c0725b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:02.689645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 566/1148] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:02.988106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf6177-8a46-4e6d-be04-ce822857daba None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:03.046130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:03.122317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf6177-8a46-4e6d-be04-ce822857daba None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:03.169644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:03.170272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:03.170548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:03.170819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:03.181893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:49:03.186739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:49:03.187929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:49:03.188863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 583/1149] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:49:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:49:03.195125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b432-ea6c-4540-a804-f52d7c0725b9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:03.268876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:03.323892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b432-ea6c-4540-a804-f52d7c0725b9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:03.361761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:03.362382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:03.362660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:03.362935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:03.363598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:03.363901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:03.365763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:03.374398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 567/1150] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:49:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:49:03.385455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:03.496588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:03.500284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42b8a4-e064-45a0-ae09-0b132103af79 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:03.540709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:03.541257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:03.541529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:03.541795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] PATH_INFO: `/v3/users/bb8a330db3a14597a11bd4648c5cce18` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:03.542927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] RBAC: Authorizing `identity:get_user(user_id=bb8a330db3a14597a11bd4648c5cce18)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:03.544378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:03.545978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 584/1151] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:49:03 2022] GET /identity/v3/users/bb8a330db3a14597a11bd4648c5cce18 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:03.553150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:03.684069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1e219-8105-4cae-b8e6-c1193177c0d0 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:03.713440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:03.729238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250144c-8b1c-4f5a-aad2-39eaa0bf9a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:03.729887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250144c-8b1c-4f5a-aad2-39eaa0bf9a4b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:03.730166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250144c-8b1c-4f5a-aad2-39eaa0bf9a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:03.730438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250144c-8b1c-4f5a-aad2-39eaa0bf9a4b None admin] PATH_INFO: `/v3/projects/8ca100f29a7b4a589f001e76e4d07baf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:03.731607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250144c-8b1c-4f5a-aad2-39eaa0bf9a4b None admin] RBAC: Authorizing `identity:get_project(project_id=8ca100f29a7b4a589f001e76e4d07baf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:03.738692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250144c-8b1c-4f5a-aad2-39eaa0bf9a4b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:03.738692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 568/1152] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:49:03 2022] GET /identity/v3/projects/8ca100f29a7b4a589f001e76e4d07baf => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:49:03.741942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:03.891401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875088d7-d35e-4fa6-a4a4-062512f2c102 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:03.934272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efdcfc-45c1-4e3a-be1d-185b270a56be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:03.934961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efdcfc-45c1-4e3a-be1d-185b270a56be None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:03.935235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efdcfc-45c1-4e3a-be1d-185b270a56be None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:03.935509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efdcfc-45c1-4e3a-be1d-185b270a56be None admin] PATH_INFO: `/v3/projects/8ca100f29a7b4a589f001e76e4d07baf/users/bb8a330db3a14597a11bd4648c5cce18/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:03.937561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efdcfc-45c1-4e3a-be1d-185b270a56be None admin] RBAC: Authorizing `identity:create_grant(project_id=8ca100f29a7b4a589f001e76e4d07baf, user_id=bb8a330db3a14597a11bd4648c5cce18, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:03.938986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efdcfc-45c1-4e3a-be1d-185b270a56be None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:03.957127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 585/1153] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:49:03 2022] PUT /identity/v3/projects/8ca100f29a7b4a589f001e76e4d07baf/users/bb8a330db3a14597a11bd4648c5cce18/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:49:06.232908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55509f7-44c4-4d72-b0a0-f587d8c5414b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:06.233481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55509f7-44c4-4d72-b0a0-f587d8c5414b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:06.233481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55509f7-44c4-4d72-b0a0-f587d8c5414b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:06.234776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 569/1154] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:06.240436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb7b7-fbd9-4c64-90f7-1830d920ad65 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:06.240921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb7b7-fbd9-4c64-90f7-1830d920ad65 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:06.241046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb7b7-fbd9-4c64-90f7-1830d920ad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:06.259327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-16beb7b7-fbd9-4c64-90f7-1830d920ad65 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:06.260559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-16beb7b7-fbd9-4c64-90f7-1830d920ad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:06.285551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:06.333748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 586/1155] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:06.626167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55509f7-44c4-4d72-b0a0-f587d8c5414b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:06.735942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55509f7-44c4-4d72-b0a0-f587d8c5414b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:06.772340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:06.772963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:06.773238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:06.773505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:06.783936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:49:06.789057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:49:06.790325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:49:06.791222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 570/1156] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:49:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:49:06.796319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beb7b7-fbd9-4c64-90f7-1830d920ad65 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:06.900902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beb7b7-fbd9-4c64-90f7-1830d920ad65 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:06.935225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:06.935829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:06.936132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:06.936405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:06.937071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:06.937413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:06.938749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:06.948023 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 587/1157] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:49:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:06.954154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:07.013541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:07.067998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3000b-d87d-4a04-b826-12a24c4ab078 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:07.106328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:07.106959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:07.107241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:07.107511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] PATH_INFO: `/v3/users/bb8a330db3a14597a11bd4648c5cce18` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:07.108635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] RBAC: Authorizing `identity:get_user(user_id=bb8a330db3a14597a11bd4648c5cce18)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:07.110069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:07.111632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 571/1158] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:49:06 2022] GET /identity/v3/users/bb8a330db3a14597a11bd4648c5cce18 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:07.119817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:07.143898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:07.231686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ab751-c16e-4a88-aaad-968a5fabd502 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:07.271347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:07.274079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:07.274079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:07.277695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:07.365895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:07.367460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:07.392529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:07.486564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 588/1159] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:49:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:49:07.492846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:07.628523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea6e4-5d05-4d07-9269-41edd019e706 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:07.666247 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:07.683529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4957-d551-4bd4-9adf-1f1b68a7631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:07.684219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4957-d551-4bd4-9adf-1f1b68a7631b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:07.684498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4957-d551-4bd4-9adf-1f1b68a7631b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:07.684765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4957-d551-4bd4-9adf-1f1b68a7631b None admin] PATH_INFO: `/v3/projects/8ca100f29a7b4a589f001e76e4d07baf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:07.685949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4957-d551-4bd4-9adf-1f1b68a7631b None admin] RBAC: Authorizing `identity:get_project(project_id=8ca100f29a7b4a589f001e76e4d07baf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:07.687405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4957-d551-4bd4-9adf-1f1b68a7631b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:07.689127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 572/1160] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:49:07 2022] GET /identity/v3/projects/8ca100f29a7b4a589f001e76e4d07baf => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:49:07.696640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:07.808842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7b7e-e401-46e6-9ac4-6b9e7134af5e None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:07.831452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:07.846555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53e8a7-09e8-49ce-ae1d-b7727d1dfe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:07.847167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e8a7-09e8-49ce-ae1d-b7727d1dfe24 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:07.847441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e8a7-09e8-49ce-ae1d-b7727d1dfe24 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:07.847710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53e8a7-09e8-49ce-ae1d-b7727d1dfe24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:07.849095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e8a7-09e8-49ce-ae1d-b7727d1dfe24 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=8ca100f29a7b4a589f001e76e4d07baf, user.id=bb8a330db3a14597a11bd4648c5cce18) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:07.849526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e8a7-09e8-49ce-ae1d-b7727d1dfe24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:07.851208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53e8a7-09e8-49ce-ae1d-b7727d1dfe24 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:07.858035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 589/1161] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:49:07 2022] GET /identity/v3/role_assignments?user.id=bb8a330db3a14597a11bd4648c5cce18&scope.project.id=8ca100f29a7b4a589f001e76e4d07baf&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:49:10.161309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192feaec-57d8-4145-a944-cc10a11c0fb9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:10.162168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192feaec-57d8-4145-a944-cc10a11c0fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:10.162168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192feaec-57d8-4145-a944-cc10a11c0fb9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:10.163495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 573/1162] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:10.170383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd281d-8208-4bab-b9a5-15a6734b624e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:10.170950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd281d-8208-4bab-b9a5-15a6734b624e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:10.171120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cd281d-8208-4bab-b9a5-15a6734b624e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:10.191774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-07cd281d-8208-4bab-b9a5-15a6734b624e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:10.193227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07cd281d-8208-4bab-b9a5-15a6734b624e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:10.271095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 590/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:10.552984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192feaec-57d8-4145-a944-cc10a11c0fb9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:10.665904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192feaec-57d8-4145-a944-cc10a11c0fb9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:10.702211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:10.702813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:10.703091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:10.703364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:10.760625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:10.773938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:10.775406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:10.880260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 574/1164] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:49:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:49:10.886513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd281d-8208-4bab-b9a5-15a6734b624e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:10.999349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cd281d-8208-4bab-b9a5-15a6734b624e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:11.015733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:11.040067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430b596-f4e2-457e-b9e4-bff25e01e3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:11.040806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430b596-f4e2-457e-b9e4-bff25e01e3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:11.041133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430b596-f4e2-457e-b9e4-bff25e01e3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:11.041458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430b596-f4e2-457e-b9e4-bff25e01e3e1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:11.049030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430b596-f4e2-457e-b9e4-bff25e01e3e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:11.050462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430b596-f4e2-457e-b9e4-bff25e01e3e1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-a430b596-f4e2-457e-b9e4-bff25e01e3e1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:49:11.062268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:49:11.063548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:49:11.064484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 591/1165] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:49:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:49:11.070332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:11.177264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:11.190689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2157c-38f9-45d2-866f-08d1f74bf931 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:11.235495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4ec15-3dc3-48a7-b5eb-9418364f0b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:11.236136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ec15-3dc3-48a7-b5eb-9418364f0b77 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:11.236416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ec15-3dc3-48a7-b5eb-9418364f0b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:11.236696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4ec15-3dc3-48a7-b5eb-9418364f0b77 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:11.237336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4ec15-3dc3-48a7-b5eb-9418364f0b77 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:11.237639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4ec15-3dc3-48a7-b5eb-9418364f0b77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:11.239851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4ec15-3dc3-48a7-b5eb-9418364f0b77 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:11.247782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 575/1166] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Sep 14 12:49:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:13.556553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c43ca-000b-4b93-842d-a31ef599c428 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:13.557186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c43ca-000b-4b93-842d-a31ef599c428 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:13.557284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c43ca-000b-4b93-842d-a31ef599c428 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:13.558873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 592/1167] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:13.565014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a487f0-ec2d-4320-96b8-e891dc5eb61b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:13.565576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a487f0-ec2d-4320-96b8-e891dc5eb61b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:13.565576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a487f0-ec2d-4320-96b8-e891dc5eb61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:13.591173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-67a487f0-ec2d-4320-96b8-e891dc5eb61b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:13.592466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-67a487f0-ec2d-4320-96b8-e891dc5eb61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:13.686757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 576/1168] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:13.964452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c43ca-000b-4b93-842d-a31ef599c428 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:14.105230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c43ca-000b-4b93-842d-a31ef599c428 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:14.148223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65017873-b2b2-4aa0-b517-587241f83e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:14.149029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017873-b2b2-4aa0-b517-587241f83e0d None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:14.149309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017873-b2b2-4aa0-b517-587241f83e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:14.149580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65017873-b2b2-4aa0-b517-587241f83e0d None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:14.150278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65017873-b2b2-4aa0-b517-587241f83e0d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:14.151982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65017873-b2b2-4aa0-b517-587241f83e0d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:14.169879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 593/1169] 10.222.0.50 () {60 vars in 1138 bytes} [Wed Sep 14 12:49:13 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:49:16.485231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05f20-acdd-48e2-a2e2-33dc17a96052 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:16.485796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05f20-acdd-48e2-a2e2-33dc17a96052 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:16.485796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05f20-acdd-48e2-a2e2-33dc17a96052 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:16.487105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 577/1170] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:16.494329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f5d71-8441-4a38-9968-28dd2f4463d3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:16.494832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f5d71-8441-4a38-9968-28dd2f4463d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:16.494922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f5d71-8441-4a38-9968-28dd2f4463d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:16.514007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-542f5d71-8441-4a38-9968-28dd2f4463d3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:16.515206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-542f5d71-8441-4a38-9968-28dd2f4463d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:16.546176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:16.591714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 594/1171] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:16.870957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05f20-acdd-48e2-a2e2-33dc17a96052 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:16.959741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:16.982265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05f20-acdd-48e2-a2e2-33dc17a96052 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:17.023742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09b1d8-1518-4adc-85d5-90779d1afe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:17.024741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b1d8-1518-4adc-85d5-90779d1afe3b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:17.025232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b1d8-1518-4adc-85d5-90779d1afe3b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:17.025955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09b1d8-1518-4adc-85d5-90779d1afe3b None admin] PATH_INFO: `/v3/domains/e4d7d41267d344749fea760f98de2322` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:17.041265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09b1d8-1518-4adc-85d5-90779d1afe3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=e4d7d41267d344749fea760f98de2322)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:17.042750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09b1d8-1518-4adc-85d5-90779d1afe3b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:17.044550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 578/1172] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Sep 14 12:49:16 2022] GET /identity/v3/domains/e4d7d41267d344749fea760f98de2322 => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:17.050616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f5d71-8441-4a38-9968-28dd2f4463d3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:17.161165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f5d71-8441-4a38-9968-28dd2f4463d3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:17.200555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a8fb2-c77c-4047-800a-6e8ed2e52037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:17.201235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8fb2-c77c-4047-800a-6e8ed2e52037 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:17.201641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8fb2-c77c-4047-800a-6e8ed2e52037 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:17.201946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a8fb2-c77c-4047-800a-6e8ed2e52037 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:17.202629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8fb2-c77c-4047-800a-6e8ed2e52037 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:17.204225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a8fb2-c77c-4047-800a-6e8ed2e52037 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:17.233933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 595/1173] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:49:17 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:49:19.619242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de93165-2dca-435b-a08b-06e8779f9ab9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:19.619678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de93165-2dca-435b-a08b-06e8779f9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:19.619793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de93165-2dca-435b-a08b-06e8779f9ab9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:19.621159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 579/1174] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:19.627129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f737440-3cd2-4d5e-a623-5754f7fbab8d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:19.627583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f737440-3cd2-4d5e-a623-5754f7fbab8d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:19.627697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f737440-3cd2-4d5e-a623-5754f7fbab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:19.650277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3f737440-3cd2-4d5e-a623-5754f7fbab8d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:19.651871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f737440-3cd2-4d5e-a623-5754f7fbab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:19.665331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:19.746328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 596/1175] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:20.090057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de93165-2dca-435b-a08b-06e8779f9ab9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:20.210243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de93165-2dca-435b-a08b-06e8779f9ab9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:20.255934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b49e9-872e-4312-bb08-cce7401a8bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:20.256758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b49e9-872e-4312-bb08-cce7401a8bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:20.257088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b49e9-872e-4312-bb08-cce7401a8bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:20.257412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b49e9-872e-4312-bb08-cce7401a8bc5 None admin] PATH_INFO: `/v3/domains/e4d7d41267d344749fea760f98de2322` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:20.259086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b49e9-872e-4312-bb08-cce7401a8bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e4d7d41267d344749fea760f98de2322)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:20.260627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b49e9-872e-4312-bb08-cce7401a8bc5 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:20.262744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 580/1176] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Sep 14 12:49:20 2022] GET /identity/v3/domains/e4d7d41267d344749fea760f98de2322 => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:20.269738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f737440-3cd2-4d5e-a623-5754f7fbab8d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:20.384151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f737440-3cd2-4d5e-a623-5754f7fbab8d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:20.427647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbcae-a94c-44cd-b7c6-64b046e9a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:20.428306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbcae-a94c-44cd-b7c6-64b046e9a121 None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:20.428590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbcae-a94c-44cd-b7c6-64b046e9a121 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:20.428864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbcae-a94c-44cd-b7c6-64b046e9a121 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:20.429544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbcae-a94c-44cd-b7c6-64b046e9a121 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:20.430995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbcae-a94c-44cd-b7c6-64b046e9a121 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:20.454471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 597/1177] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:49:20 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:49:22.855935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85bfa3-6d17-4758-b605-8c1a1e2c383c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:22.856541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85bfa3-6d17-4758-b605-8c1a1e2c383c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:22.856646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85bfa3-6d17-4758-b605-8c1a1e2c383c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:22.857902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 581/1178] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:22.864396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69bf7a-5807-47e5-b03c-5c0e9fc8f701 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:22.864864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69bf7a-5807-47e5-b03c-5c0e9fc8f701 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:22.864972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69bf7a-5807-47e5-b03c-5c0e9fc8f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:22.871897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:22.886973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ee69bf7a-5807-47e5-b03c-5c0e9fc8f701 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:22.888202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ee69bf7a-5807-47e5-b03c-5c0e9fc8f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:22.966613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 598/1179] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:23.248704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85bfa3-6d17-4758-b605-8c1a1e2c383c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:23.261441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:23.365389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85bfa3-6d17-4758-b605-8c1a1e2c383c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:23.413558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:23.414594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:23.415051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:23.415514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:23.435841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:49:23.442388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:49:23.443655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:49:23.444984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 582/1180] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:49:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:49:23.449941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69bf7a-5807-47e5-b03c-5c0e9fc8f701 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:23.572573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69bf7a-5807-47e5-b03c-5c0e9fc8f701 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:23.605449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:23.611287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:23.611906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:23.612218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:23.612560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:23.613855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:23.614126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:23.615450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:23.625984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 599/1181] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:49:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:23.633062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:23.723194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:23.765339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1a458-8236-422d-b979-324d22b1ac08 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:23.803945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:23.804612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:23.804889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:23.805163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] PATH_INFO: `/v3/users/493d91bb98a74b99b2590011bfde2755` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:23.825543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] RBAC: Authorizing `identity:get_user(user_id=493d91bb98a74b99b2590011bfde2755)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:23.828087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:23.830308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 583/1182] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:49:23 2022] GET /identity/v3/users/493d91bb98a74b99b2590011bfde2755 => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:23.837298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:23.950775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101873a-bb1c-4d41-8a74-9c340369183c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:23.996188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:23.997221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:23.997684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:23.998100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:24.076184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:24.086654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:24.088151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:24.205888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 600/1183] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:49:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:49:24.213158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:24.325343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bebaa10-07f2-46be-93c8-d585dad7b885 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:24.355613 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:24.366900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78627d4-f052-4b14-903c-9340678eae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:24.367555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78627d4-f052-4b14-903c-9340678eae77 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:24.367832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78627d4-f052-4b14-903c-9340678eae77 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:24.368135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78627d4-f052-4b14-903c-9340678eae77 None admin] PATH_INFO: `/v3/projects/afea00a3c30e4b6796999441ed1bd75f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:24.369746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78627d4-f052-4b14-903c-9340678eae77 None admin] RBAC: Authorizing `identity:get_project(project_id=afea00a3c30e4b6796999441ed1bd75f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:24.371818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78627d4-f052-4b14-903c-9340678eae77 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:24.373773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 584/1184] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:49:24 2022] GET /identity/v3/projects/afea00a3c30e4b6796999441ed1bd75f => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:24.381728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:24.487279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:24.498889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1067244-99bd-4feb-8fb5-d431e58887c3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:24.539712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8c89e-bf6e-4013-95fe-2eed1f1b8ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:24.540357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c89e-bf6e-4013-95fe-2eed1f1b8ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:24.540633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c89e-bf6e-4013-95fe-2eed1f1b8ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:24.540906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8c89e-bf6e-4013-95fe-2eed1f1b8ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:24.541648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8c89e-bf6e-4013-95fe-2eed1f1b8ed1 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=afea00a3c30e4b6796999441ed1bd75f, user.id=493d91bb98a74b99b2590011bfde2755) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:24.541973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8c89e-bf6e-4013-95fe-2eed1f1b8ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:24.543388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8c89e-bf6e-4013-95fe-2eed1f1b8ed1 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:24.549711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 601/1185] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:49:24 2022] GET /identity/v3/role_assignments?user.id=493d91bb98a74b99b2590011bfde2755&scope.project.id=afea00a3c30e4b6796999441ed1bd75f&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:49:26.826760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80c04-d0c6-416b-a254-b0bd855b74dc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:26.827321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80c04-d0c6-416b-a254-b0bd855b74dc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:26.827321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c80c04-d0c6-416b-a254-b0bd855b74dc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:26.828656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 585/1186] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:49:26.834694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51d28-7a65-4d5e-a271-8fff1f6031cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:26.835166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51d28-7a65-4d5e-a271-8fff1f6031cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:26.835329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb51d28-7a65-4d5e-a271-8fff1f6031cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:26.854534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fbb51d28-7a65-4d5e-a271-8fff1f6031cf None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:26.855724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fbb51d28-7a65-4d5e-a271-8fff1f6031cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:26.934993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 602/1187] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:27.211413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c80c04-d0c6-416b-a254-b0bd855b74dc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:27.333079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c80c04-d0c6-416b-a254-b0bd855b74dc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:27.373308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:27.373935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:27.374204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:27.374465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:27.388107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:49:27.393471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:49:27.395187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:49:27.396436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 586/1188] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:49:27.402425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51d28-7a65-4d5e-a271-8fff1f6031cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:27.496521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:27.510739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb51d28-7a65-4d5e-a271-8fff1f6031cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:27.561426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:27.562080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:27.562354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:27.562620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:27.563311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:27.563611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:27.565050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:27.575561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 603/1189] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:27.582927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:27.656419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:27.725271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1c755-633c-41c6-9392-dbf46ac7e68b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:27.777429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:27.778207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:27.778619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:27.779003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] PATH_INFO: `/v3/users/493d91bb98a74b99b2590011bfde2755` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:27.780907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] RBAC: Authorizing `identity:get_user(user_id=493d91bb98a74b99b2590011bfde2755)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:27.783064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:27.786024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 587/1190] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:49:27 2022] GET /identity/v3/users/493d91bb98a74b99b2590011bfde2755 => generated 311 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:27.794081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:27.922310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb9489-1f5e-41d3-968e-70b8a4551e4d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:27.972509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ec501-9370-4b88-bc3a-5f0899f288d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:27.973496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec501-9370-4b88-bc3a-5f0899f288d8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:27.973907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec501-9370-4b88-bc3a-5f0899f288d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:27.974494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec501-9370-4b88-bc3a-5f0899f288d8 None admin] PATH_INFO: `/v3/projects/afea00a3c30e4b6796999441ed1bd75f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:27.975967 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ec501-9370-4b88-bc3a-5f0899f288d8 None admin] RBAC: Authorizing `identity:get_project(project_id=afea00a3c30e4b6796999441ed1bd75f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:27.977815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ec501-9370-4b88-bc3a-5f0899f288d8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:27.980229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 604/1191] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:49:27 2022] GET /identity/v3/projects/afea00a3c30e4b6796999441ed1bd75f => generated 361 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:27.989225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:28.161343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8450c-a20c-46fd-8b77-f6c46c4ca480 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:28.186783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:28.200571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c10bb-1e59-4ff6-979f-41744256fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:28.201324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c10bb-1e59-4ff6-979f-41744256fa09 None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:28.201638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c10bb-1e59-4ff6-979f-41744256fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:28.201962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c10bb-1e59-4ff6-979f-41744256fa09 None admin] PATH_INFO: `/v3/projects/afea00a3c30e4b6796999441ed1bd75f/users/493d91bb98a74b99b2590011bfde2755/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:28.204122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c10bb-1e59-4ff6-979f-41744256fa09 None admin] RBAC: Authorizing `identity:create_grant(project_id=afea00a3c30e4b6796999441ed1bd75f, user_id=493d91bb98a74b99b2590011bfde2755, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:28.205806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c10bb-1e59-4ff6-979f-41744256fa09 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:28.221785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 588/1192] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:49:27 2022] PUT /identity/v3/projects/afea00a3c30e4b6796999441ed1bd75f/users/493d91bb98a74b99b2590011bfde2755/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:49:30.550928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f00b3-95c0-4676-90e4-ec5b24e2508d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:30.551512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f00b3-95c0-4676-90e4-ec5b24e2508d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:30.551512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f00b3-95c0-4676-90e4-ec5b24e2508d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:30.552830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 605/1193] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:49:30.558800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef7c0-1534-4f27-aa17-a209d9fd9d4e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:30.559395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef7c0-1534-4f27-aa17-a209d9fd9d4e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:30.559395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ef7c0-1534-4f27-aa17-a209d9fd9d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:30.578993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-082ef7c0-1534-4f27-aa17-a209d9fd9d4e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:49:30.580247 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-082ef7c0-1534-4f27-aa17-a209d9fd9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:49:30.661269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 589/1194] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:49:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:49:30.959485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f00b3-95c0-4676-90e4-ec5b24e2508d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:30.981862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:31.083927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f00b3-95c0-4676-90e4-ec5b24e2508d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:31.120802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:31.121436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:31.121712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:31.121984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:31.135606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:49:31.140634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:49:31.142580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:49:31.145282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 606/1195] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:49:31.150059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ef7c0-1534-4f27-aa17-a209d9fd9d4e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:31.279169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ef7c0-1534-4f27-aa17-a209d9fd9d4e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:31.297899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:31.329269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:31.330061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:31.330392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:31.330723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:31.331569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:31.332540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:31.334166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:31.344679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 590/1196] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:49:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:31.350979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:31.460931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:31.489713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb1c57-2cae-4ec3-8e33-2c2d5b17ddfc None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:31.545101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:31.545757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:31.546093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:31.546411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] PATH_INFO: `/v3/users/493d91bb98a74b99b2590011bfde2755` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:31.547799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] RBAC: Authorizing `identity:get_user(user_id=493d91bb98a74b99b2590011bfde2755)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:31.549655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:31.552364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 607/1197] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Sep 14 12:49:31 2022] GET /identity/v3/users/493d91bb98a74b99b2590011bfde2755 => generated 311 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:31.558540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:31.694022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef61a1-c5c9-46d6-b5a9-51004fe27257 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:31.736762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:31.737385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:31.737666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:31.738346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:31.799232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:31.826613 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:31.828098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:31.940384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 591/1198] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:49:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:49:31.947319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:32.065087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877cdec-9286-40ae-8c12-fe3728dfbe32 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:32.111678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871018-f82e-4353-a47e-df106e359ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:32.112564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871018-f82e-4353-a47e-df106e359ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:32.112956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871018-f82e-4353-a47e-df106e359ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:32.113234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871018-f82e-4353-a47e-df106e359ad8 None admin] PATH_INFO: `/v3/projects/afea00a3c30e4b6796999441ed1bd75f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:32.114779 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc871018-f82e-4353-a47e-df106e359ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=afea00a3c30e4b6796999441ed1bd75f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:32.116585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc871018-f82e-4353-a47e-df106e359ad8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:32.118970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 608/1199] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Sep 14 12:49:31 2022] GET /identity/v3/projects/afea00a3c30e4b6796999441ed1bd75f => generated 361 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:32.126876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:49:32.221153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:32.251588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7b22c-263f-40b3-be3e-44ab61cc72e9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:49:32.297172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9b463-5f30-4f09-82a2-9d620e3ed704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:49:32.297960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b463-5f30-4f09-82a2-9d620e3ed704 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:49:32.298296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b463-5f30-4f09-82a2-9d620e3ed704 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:49:32.298630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9b463-5f30-4f09-82a2-9d620e3ed704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:49:32.299618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9b463-5f30-4f09-82a2-9d620e3ed704 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=afea00a3c30e4b6796999441ed1bd75f, user.id=493d91bb98a74b99b2590011bfde2755) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:49:32.300050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9b463-5f30-4f09-82a2-9d620e3ed704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:49:32.302564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9b463-5f30-4f09-82a2-9d620e3ed704 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:49:32.310831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 592/1200] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:49:32 2022] GET /identity/v3/role_assignments?user.id=493d91bb98a74b99b2590011bfde2755&scope.project.id=afea00a3c30e4b6796999441ed1bd75f&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:49:42.107380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:49:42.307213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=30 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:36.183377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b9de-4f8d-4d68-ab46-78386cce648b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:36.184214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b9de-4f8d-4d68-ab46-78386cce648b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:36.184214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b9de-4f8d-4d68-ab46-78386cce648b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:36.188075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 609/1201] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:50:36.196055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659bcd-4692-4f4a-8ab0-98c5da2ba153 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:36.196055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659bcd-4692-4f4a-8ab0-98c5da2ba153 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:36.196055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14659bcd-4692-4f4a-8ab0-98c5da2ba153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:36.217194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-14659bcd-4692-4f4a-8ab0-98c5da2ba153 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:50:36.218641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-14659bcd-4692-4f4a-8ab0-98c5da2ba153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:50:36.307631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 593/1202] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:50:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:50:36.666997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8b9de-4f8d-4d68-ab46-78386cce648b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:36.820371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8b9de-4f8d-4d68-ab46-78386cce648b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:36.868642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:36.869322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:36.869620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:36.869908 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:36.884676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:36.886689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:36.907887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:36.909106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:36.910119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:36.910119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:36.910119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:36.914876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 610/1203] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:36.917362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659bcd-4692-4f4a-8ab0-98c5da2ba153 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:37.099596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14659bcd-4692-4f4a-8ab0-98c5da2ba153 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:37.152497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:37.161912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78aacf-240b-42c8-b76c-dfa26449bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:37.162655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78aacf-240b-42c8-b76c-dfa26449bdcc None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:37.163174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78aacf-240b-42c8-b76c-dfa26449bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:37.163658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78aacf-240b-42c8-b76c-dfa26449bdcc None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:37.164985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78aacf-240b-42c8-b76c-dfa26449bdcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:37.165692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78aacf-240b-42c8-b76c-dfa26449bdcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:37.167601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78aacf-240b-42c8-b76c-dfa26449bdcc None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:37.184946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 594/1204] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:50:37.192797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:37.281120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:37.345734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c5c4c-fe6b-47d2-b502-0c56710eb1c2 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:37.402637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb0fce-46fe-4bca-89b3-0dbfc74241bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:37.403323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb0fce-46fe-4bca-89b3-0dbfc74241bc None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:37.403710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb0fce-46fe-4bca-89b3-0dbfc74241bc None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:37.404068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb0fce-46fe-4bca-89b3-0dbfc74241bc None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:37.404819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb0fce-46fe-4bca-89b3-0dbfc74241bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:37.408386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceb0fce-46fe-4bca-89b3-0dbfc74241bc None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:37.438407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 611/1205] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Sep 14 12:50:37 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:50:40.225005 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd3f3-91e7-4d64-8238-842422dfcfc4 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:40.225749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd3f3-91e7-4d64-8238-842422dfcfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:40.225749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bd3f3-91e7-4d64-8238-842422dfcfc4 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:40.227325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 595/1206] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:50:40.233162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750779c0-f5a9-48de-a0fa-e7b3f24cd794 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:40.233643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750779c0-f5a9-48de-a0fa-e7b3f24cd794 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:40.233740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750779c0-f5a9-48de-a0fa-e7b3f24cd794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:40.255847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-750779c0-f5a9-48de-a0fa-e7b3f24cd794 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:50:40.257638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-750779c0-f5a9-48de-a0fa-e7b3f24cd794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:50:40.354524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 612/1207] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:50:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:50:40.730762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd3f3-91e7-4d64-8238-842422dfcfc4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:40.881355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bd3f3-91e7-4d64-8238-842422dfcfc4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:40.929525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:40.930312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:40.930496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:40.930758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:40.944310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:50:40.949871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:40.951536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:40.952854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 596/1208] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:40.958193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750779c0-f5a9-48de-a0fa-e7b3f24cd794 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:41.013826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:41.089093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750779c0-f5a9-48de-a0fa-e7b3f24cd794 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:41.139832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:41.140495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:41.140959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:41.141341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:41.142188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:41.142499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:41.144055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:41.154762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 613/1209] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:50:41.161980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:41.236505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:41.316612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d007f6-59c2-4868-88fd-b889e9de3941 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:41.356599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:41.357257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:41.357597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:41.357856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:41.371167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:41.373787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:41.392618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:41.393693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:41.394619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:41.394619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:41.394619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:41.395298 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 597/1210] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:50:41.400645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:41.556293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:41.560897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1a3f5-edb6-4fb1-b76f-79472b351f87 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:41.608777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:41.609788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:41.610060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:41.610366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:41.611374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:41.611687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:41.615372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:41.632767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 614/1211] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:41.634941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:41.775065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edb20d-4fb1-4844-a98b-4cddea5aaff1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:41.777141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:41.852957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:41.853743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:41.854096 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:41.854440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:41.864078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:41.866063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:50:41.879254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:41.880846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:41.882271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 598/1212] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:41.888677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:42.007814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f8138-52b5-4140-84e2-34fc17c052da None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:42.058793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:42.059348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:42.059643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:42.059901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:42.060780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:42.061018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:42.062485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:42.085987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 615/1213] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Sep 14 12:50:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:42.092372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:42.230399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5025f3-0afe-4cde-8d38-1fb8d0cf1ad2 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:42.269157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:42.269897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:42.270126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:42.270395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:42.309504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:42.356913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:42.358356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:42.483173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 599/1214] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:50:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 14 12:50:42.484526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:42.506136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:42.607263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297891f4-f113-44e0-b2f2-3000e46f5664 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:42.659106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:42.659740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:42.660044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:42.660365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:42.671172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:42.672964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:42.691830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:42.692942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:42.693867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:42.693867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:42.693867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:42.693867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 616/1215] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:50:42.699466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:42.782238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:42.833087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573d909-6008-4982-bd9e-0d502aabcab3 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:42.874522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:42.876242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:42.876242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:42.876736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:42.877931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:42.878410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:42.880548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:42.897177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 600/1216] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:50:42.904338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:42.993811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:43.034280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce6ce-6bda-4b7c-a7b0-a4232e7607c3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:43.076162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:43.076848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:43.077165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:43.077517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:43.085795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:43.087453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:50:43.100944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:43.102223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:43.103359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 617/1217] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:43.110471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:43.244288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d80bde-5c4a-48fa-a012-9ad30bce4ae1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:43.271079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:43.286446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac63c8-9664-4561-aad5-09bcf6aa4178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:43.287219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac63c8-9664-4561-aad5-09bcf6aa4178 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:43.287514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac63c8-9664-4561-aad5-09bcf6aa4178 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:43.287861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac63c8-9664-4561-aad5-09bcf6aa4178 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:43.288645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac63c8-9664-4561-aad5-09bcf6aa4178 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:43.289017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac63c8-9664-4561-aad5-09bcf6aa4178 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:43.290622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac63c8-9664-4561-aad5-09bcf6aa4178 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:43.315307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 601/1218] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:43.316539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:43.431414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcf911-dae5-4506-8c8f-b66c8b076768 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:43.466330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:43.473035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f55511-c976-447c-8a4e-8f7c3a662dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:43.473754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55511-c976-447c-8a4e-8f7c3a662dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:43.475377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55511-c976-447c-8a4e-8f7c3a662dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:43.475377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f55511-c976-447c-8a4e-8f7c3a662dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:43.475377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f55511-c976-447c-8a4e-8f7c3a662dd0 None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=75d6d17c6b22402ca39158a737027f11) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:43.475647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f55511-c976-447c-8a4e-8f7c3a662dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:43.477125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f55511-c976-447c-8a4e-8f7c3a662dd0 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:43.482985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 618/1219] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:50:43 2022] GET /identity/v3/role_assignments?user.id=75d6d17c6b22402ca39158a737027f11&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:45.846443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0335-0fb0-43b9-86cb-d289da226e5c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:45.847149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0335-0fb0-43b9-86cb-d289da226e5c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:45.847149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc0335-0fb0-43b9-86cb-d289da226e5c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:45.848541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 602/1220] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:50:45.855401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d1fd9-1e8a-4b5a-abf7-35d1b8fb7210 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:45.856144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d1fd9-1e8a-4b5a-abf7-35d1b8fb7210 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:45.856144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d1fd9-1e8a-4b5a-abf7-35d1b8fb7210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:45.877054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-528d1fd9-1e8a-4b5a-abf7-35d1b8fb7210 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:50:45.878285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-528d1fd9-1e8a-4b5a-abf7-35d1b8fb7210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:50:45.967015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 619/1221] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:50:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:50:46.262086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0335-0fb0-43b9-86cb-d289da226e5c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:46.443305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc0335-0fb0-43b9-86cb-d289da226e5c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:46.494056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:46.494627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:46.494917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:46.495191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:46.518840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:50:46.528824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:46.530319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:46.531864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 603/1222] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:50:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:46.542188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d1fd9-1e8a-4b5a-abf7-35d1b8fb7210 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:46.735191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d1fd9-1e8a-4b5a-abf7-35d1b8fb7210 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:46.760598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:46.772717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:46.773231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:46.773540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:46.773853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:46.774789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] RBAC: Adding query filter params (name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:46.775087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:46.776539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:46.787099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 620/1223] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:50:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:46.794279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:46.849941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:46.910656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f66b-9f2a-4102-8652-7ca28fedb46c None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:46.979339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:46.980535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:46.980924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:46.981210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:47.004703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:47.007825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:47.048806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:47.051421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:47.052484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:47.052484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:47.052484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:47.052484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 604/1224] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:50:47.060795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:47.241093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18616b-f836-440f-9d09-17d004b4d92d None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:47.292915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:47.293629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:47.294023 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:47.294383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:47.295152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:47.295596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:47.297567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:47.331339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 621/1225] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:47.332780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:47.478140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:47.486929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab477e64-05bf-46b5-9355-7ab60d8178ee None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:47.547444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:47.548768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:47.549235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:47.549673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:47.561679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:47.563722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:50:47.591107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:47.592477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:47.600785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 605/1226] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:47.605178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:47.689306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:47.764661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbbf5e-f804-4549-8584-9e59c60293c7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:47.807118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:47.807713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:47.808007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:47.808281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:47.809121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:47.809393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:47.810943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:47.833411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 622/1227] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Sep 14 12:50:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:47.840441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:47.998128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92265f6-0cc3-496d-8fa9-db38ab767be9 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:48.055361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:48.056142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:48.056478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:48.056807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:48.072840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:48.074153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:48.096837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:48.098472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:48.099911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:48.099911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:48.099911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:48.099911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 606/1228] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:48.104559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:48.266455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914c2d1-fe21-4b63-ab54-d8af7d7f8a21 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:48.269389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:48.309901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:48.310630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:48.310930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:48.311277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:48.312076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:48.312430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:48.314585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:48.331807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 623/1229] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:50:48.339324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:48.353249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:48.503638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300407-3141-4913-8f5e-8b7fa4113959 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:48.559725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:48.560324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:48.560604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:48.560878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:48.572193 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:48.573930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:50:48.589873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:48.591616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:48.593217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 607/1230] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:48.602005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:48.759468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b307d-e4b0-4f8c-a557-25ea3af8bb5f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:48.818245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cac125-fcf1-4aee-8fed-7a1058b33748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:48.818474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac125-fcf1-4aee-8fed-7a1058b33748 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:48.818643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac125-fcf1-4aee-8fed-7a1058b33748 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:48.818914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cac125-fcf1-4aee-8fed-7a1058b33748 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:48.819605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac125-fcf1-4aee-8fed-7a1058b33748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:48.819902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac125-fcf1-4aee-8fed-7a1058b33748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:48.821361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cac125-fcf1-4aee-8fed-7a1058b33748 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:48.837421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 624/1231] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:50:48.843853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:48.946843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:49.015006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8594ce-a032-4808-8583-05aa9ff62e64 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:49.081600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf59f7-994e-475f-8247-071b4364cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:49.082322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf59f7-994e-475f-8247-071b4364cd3e None admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:49.082675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf59f7-994e-475f-8247-071b4364cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:49.083060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf59f7-994e-475f-8247-071b4364cd3e None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/75d6d17c6b22402ca39158a737027f11/roles/67bbea02b9dc4cc392c0ac937749dc57` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:49.106874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf59f7-994e-475f-8247-071b4364cd3e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=75d6d17c6b22402ca39158a737027f11, role_id=67bbea02b9dc4cc392c0ac937749dc57)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:49.108741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf59f7-994e-475f-8247-071b4364cd3e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:49.134296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 608/1232] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:50:48 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/75d6d17c6b22402ca39158a737027f11/roles/67bbea02b9dc4cc392c0ac937749dc57 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:50:51.739774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15acd1-4371-4fb7-a0ef-7f54951411b8 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:51.741463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15acd1-4371-4fb7-a0ef-7f54951411b8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:51.741463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15acd1-4371-4fb7-a0ef-7f54951411b8 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:51.742269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 625/1233] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:50:51.749032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cdf4-dd6b-4a3c-b132-4b01dff4a37f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:51.750221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cdf4-dd6b-4a3c-b132-4b01dff4a37f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:51.750221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2cdf4-dd6b-4a3c-b132-4b01dff4a37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:51.773215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f7b2cdf4-dd6b-4a3c-b132-4b01dff4a37f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:50:51.774965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f7b2cdf4-dd6b-4a3c-b132-4b01dff4a37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:50:51.874590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 609/1234] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:50:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:50:52.224690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15acd1-4371-4fb7-a0ef-7f54951411b8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:52.257049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:52.357544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15acd1-4371-4fb7-a0ef-7f54951411b8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:52.409404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:52.410181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:52.410611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:52.410860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:52.426952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:50:52.433553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:52.434918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:52.436085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 626/1235] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Sep 14 12:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:52.444477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cdf4-dd6b-4a3c-b132-4b01dff4a37f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:52.504143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:52.589353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2cdf4-dd6b-4a3c-b132-4b01dff4a37f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:52.642489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:52.643261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:52.643544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:52.643898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:52.645187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:52.645544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:52.647243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:52.661084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 610/1236] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Sep 14 12:50:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:50:52.668533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:52.803440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:52.833919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb646-79e0-4176-886a-5dd3faa846a7 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:52.883974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:52.888106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:52.888106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:52.888106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:52.906627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:52.909819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:52.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:52.944203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:52.945523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:52.945523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:52.945523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:52.945523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 627/1237] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:52.951165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:53.126862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150cb7b-1d3e-4c50-8270-c011234e7d0a None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:53.144322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:53.196438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:53.197165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:53.197644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:53.197997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:53.198669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:53.199185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:53.200980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:53.224097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 611/1238] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:53.233169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:53.391801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00412d-47c9-4128-9134-215d9b7b9873 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:53.449475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:53.450873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:53.451362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:53.452290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:53.456726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:53.464601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:53.466890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:50:53.491246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:53.493100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:53.495549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 628/1239] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:53.501015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:53.672034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d38f9c-3be9-4531-80b1-3c4e4aa38c86 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:53.724502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:53.725140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:53.725422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:53.725695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:53.726786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:53.727249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:53.728950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:53.752843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 612/1240] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Sep 14 12:50:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:53.760662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:53.899393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36194414-0bd5-467d-ac49-cb669e4a7e09 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:53.946440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:53.946975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:53.947253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:53.947526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:54.031773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:54.042424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:54.044844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:54.196764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 629/1241] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:50:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:50:54.205000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:54.243039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:54.349511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129de426-4530-40c8-969f-0a2a384d6d82 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:54.400300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:54.400991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:54.401278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:54.401534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:54.417366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:54.419103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:54.443521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:54.445491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:54.447459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:54.447459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:54.447459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:54.447459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 613/1242] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:50:54.451576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:54.603967 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:54.625098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de8824-6ea5-4475-86d2-4c6a2b7ab58b None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:54.693517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:54.694244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:54.694596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:54.694872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:54.695569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:54.695900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:54.697856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:54.713123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 630/1243] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:50:54.722695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:54.862619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:54.894348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c9a97-e256-4e45-8c59-df1a879ddbef None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:54.939719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:54.940452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:54.940736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:54.941082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:54.958558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:54.960991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:50:54.986956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:54.988791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:50:54.996972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 614/1244] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:50:54.997821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:55.153785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957330d5-cdf1-4589-8f59-a3778488006a None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:55.198046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c8664-7eee-4cd3-8c0f-cebb49be1108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:55.198716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8664-7eee-4cd3-8c0f-cebb49be1108 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:55.199069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8664-7eee-4cd3-8c0f-cebb49be1108 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:55.199323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8664-7eee-4cd3-8c0f-cebb49be1108 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:55.200193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c8664-7eee-4cd3-8c0f-cebb49be1108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:55.200504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c8664-7eee-4cd3-8c0f-cebb49be1108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:55.202146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c8664-7eee-4cd3-8c0f-cebb49be1108 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:55.230980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 631/1245] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:55.237795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:55.375204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c287bf-e1a7-4450-aa88-10769a640f1d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:55.422695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3d6e4-08b4-4db7-a2c2-81fdb53af57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:55.423607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d6e4-08b4-4db7-a2c2-81fdb53af57f None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:55.423941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d6e4-08b4-4db7-a2c2-81fdb53af57f None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:55.424302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3d6e4-08b4-4db7-a2c2-81fdb53af57f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:55.425456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3d6e4-08b4-4db7-a2c2-81fdb53af57f None admin] RBAC: Adding query filter params (role.id=67bbea02b9dc4cc392c0ac937749dc57, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=75d6d17c6b22402ca39158a737027f11) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:55.425800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3d6e4-08b4-4db7-a2c2-81fdb53af57f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:55.428878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3d6e4-08b4-4db7-a2c2-81fdb53af57f None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:55.436710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 615/1246] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:50:55 2022] GET /identity/v3/role_assignments?user.id=75d6d17c6b22402ca39158a737027f11&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=67bbea02b9dc4cc392c0ac937749dc57 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:58.039275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40184-ff45-4ba9-a842-f97cedc6b772 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:58.040320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40184-ff45-4ba9-a842-f97cedc6b772 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:58.040320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d40184-ff45-4ba9-a842-f97cedc6b772 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:58.041451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 632/1247] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:50:58.050637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ce0cc-27a0-4ce7-bd57-3e012b65e811 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:58.051307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ce0cc-27a0-4ce7-bd57-3e012b65e811 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:58.051307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ce0cc-27a0-4ce7-bd57-3e012b65e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:58.059130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:58.079525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a55ce0cc-27a0-4ce7-bd57-3e012b65e811 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:50:58.082099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a55ce0cc-27a0-4ce7-bd57-3e012b65e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:50:58.186872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 616/1248] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:50:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 14 12:50:58.516701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d40184-ff45-4ba9-a842-f97cedc6b772 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:58.548800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:58.658962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d40184-ff45-4ba9-a842-f97cedc6b772 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:58.716927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:58.717739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:58.718197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:58.718490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:58.732487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:50:58.739036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:58.741552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:58.743454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 633/1249] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:50:58.752202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ce0cc-27a0-4ce7-bd57-3e012b65e811 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:58.905233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ce0cc-27a0-4ce7-bd57-3e012b65e811 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:58.954179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:58.962657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:58.963323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:58.963604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:58.963877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:58.964722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:58.965069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:58.966677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:58.980423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 617/1250] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:50:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:58.987758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:59.135511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:59.175208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c927de-4830-4b14-acc9-1b93fe668a98 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:59.227465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:59.228309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:59.228728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:59.228984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:59.245202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:59.246122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:50:59.269520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:59.270777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:50:59.271962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:50:59.271962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:50:59.271962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:59.271962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 634/1251] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:50:59.277677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:59.414092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443b0a0-602b-4e62-86af-390686bed324 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:59.465823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:59.466493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:59.466861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:59.467149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:59.467793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:59.468227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:59.470157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:59.483218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 618/1252] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:59.491324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:59.630913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922eac85-3280-4195-b905-e02732dcc757 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:59.668371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:59.678006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:59.678658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:59.678944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:59.679299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:59.689519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:59.690930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:50:59.707567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:50:59.710546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:50:59.713353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 635/1253] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:50:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:50:59.718815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:50:59.792486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:50:59.861942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a60d46-6be5-4964-bb53-9fb24e22ffb6 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:50:59.919503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:50:59.920295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:50:59.920736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:50:59.921455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:50:59.922569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:50:59.922877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:50:59.924359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:50:59.951132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 619/1254] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Sep 14 12:50:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:50:59.958968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:00.127185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a3298-1c03-4ef0-ab3c-a3332fc21f01 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:00.170817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:00.172111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:00.172234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:00.172558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:00.261877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:00.283260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:00.285273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:00.431318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 636/1255] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:50:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:51:00.440543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:00.600569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975b757-8d47-4419-b1e1-9d05897bcc48 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:00.626684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:00.665051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:00.665718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:00.665991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:00.666263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:00.685322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:00.686862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:51:00.705380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:00.706699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:51:00.707754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:51:00.707754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:00.707754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:00.707754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 620/1256] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:00.714061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:00.837066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:00.854689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b7d9-2a3b-4738-89f1-5231fdc1fbb8 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:00.916870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:00.917502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:00.917782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:00.918057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:00.918725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:00.919025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:00.920475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:00.933373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 637/1257] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:00.940147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:01.103034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b8e32-1894-4319-b1bb-4463aeb12556 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:01.152260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:01.152928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:01.153323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:01.153779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:01.167196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:01.169238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:51:01.186907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:01.188881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:01.190355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 621/1258] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:01.196169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:01.341009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47caccd2-c9af-40c8-a70d-03c8c4552fe3 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:01.386628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08798fef-fa0b-482b-b8c4-cc9bcc89c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:01.387245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798fef-fa0b-482b-b8c4-cc9bcc89c349 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:01.387518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798fef-fa0b-482b-b8c4-cc9bcc89c349 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:01.387786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08798fef-fa0b-482b-b8c4-cc9bcc89c349 None admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:01.388814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08798fef-fa0b-482b-b8c4-cc9bcc89c349 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:01.389266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08798fef-fa0b-482b-b8c4-cc9bcc89c349 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:01.391609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08798fef-fa0b-482b-b8c4-cc9bcc89c349 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:01.410876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 638/1259] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:01.418225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:01.450463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:01.533986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614360da-2c0a-4811-9030-cbbc5040d46e None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:01.570849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4db6e-594b-48b1-846f-f76ca574694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:01.571467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4db6e-594b-48b1-846f-f76ca574694e None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:01.571743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4db6e-594b-48b1-846f-f76ca574694e None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:01.572040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4db6e-594b-48b1-846f-f76ca574694e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:01.572776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4db6e-594b-48b1-846f-f76ca574694e None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=75d6d17c6b22402ca39158a737027f11) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:01.573083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4db6e-594b-48b1-846f-f76ca574694e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:01.574536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4db6e-594b-48b1-846f-f76ca574694e None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:01.584133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 622/1260] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:51:01 2022] GET /identity/v3/role_assignments?user.id=75d6d17c6b22402ca39158a737027f11&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:03.826001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00ed6-745c-40a7-a72c-aadacbcc2bb6 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:03.826594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00ed6-745c-40a7-a72c-aadacbcc2bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:03.826594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b00ed6-745c-40a7-a72c-aadacbcc2bb6 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:03.828551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 639/1261] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:51:03.834717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3046-68f9-4c87-a0dd-963ec172056f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:03.835305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3046-68f9-4c87-a0dd-963ec172056f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:03.835305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce3046-68f9-4c87-a0dd-963ec172056f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:03.854001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-28ce3046-68f9-4c87-a0dd-963ec172056f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:51:03.855207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-28ce3046-68f9-4c87-a0dd-963ec172056f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:51:03.933078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 623/1262] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:51:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:51:04.231750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00ed6-745c-40a7-a72c-aadacbcc2bb6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:04.244367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:04.348843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b00ed6-745c-40a7-a72c-aadacbcc2bb6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:04.387363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:04.388089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:04.388298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:04.388564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:04.399501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:51:04.404336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:04.406406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:51:04.407937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 640/1263] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:04.412590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce3046-68f9-4c87-a0dd-963ec172056f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:04.433020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:04.527373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce3046-68f9-4c87-a0dd-963ec172056f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:04.565385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:04.565994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:04.566266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:04.566532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:04.567186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:04.567488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:04.568968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:04.578268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 624/1264] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:04.584501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:04.663716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:04.705515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f86541-8099-490d-8777-c1df710ec214 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:04.743047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:04.743686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:04.743959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:04.744333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:04.757707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:04.759458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:51:04.778885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:04.780144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:51:04.781892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:51:04.781892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:04.781892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:51:04.781892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 641/1265] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:04.786917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:04.885383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:04.910374 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278453ce-f045-4091-ae2c-41cf9a5d0786 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:04.945860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:04.946463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:04.946739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:04.947012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:04.947654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:04.948547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:04.949354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:04.962865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 625/1266] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:04.969731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:05.083938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb928e00-0cce-4830-a472-7f6d452fd812 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:05.103872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:05.119735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:05.120407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:05.120672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:05.120940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:05.130938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:05.132500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:51:05.147351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:05.148471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:51:05.149928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 642/1267] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:51:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:05.154795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:05.262175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632a36b-c429-40c5-88c5-56b1b569a41d None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:05.299010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:05.299639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:05.299935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:05.300238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:05.300975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:05.301280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:05.302722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:05.319063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:05.330497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 626/1268] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Sep 14 12:51:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:05.336829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:05.456969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a93261-195b-4066-8297-94f6a49a0748 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:05.496408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:05.497046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:05.497323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:05.497599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:05.509787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:05.511257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:51:05.527547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:05.528953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:51:05.530374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:51:05.530374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:05.530374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:51:05.530374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 643/1269] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:05.534961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:05.655194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6cff-f740-4df9-ba78-c5222885eab7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:05.696390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:05.697003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:05.697279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:05.697543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:05.698190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:05.698489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:05.699889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:05.712482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 627/1270] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:05.719575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:05.754046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:05.842012 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07340782-2f91-42a4-ae19-15cb1645591c None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:05.885976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:05.886835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:05.887240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:05.887560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:05.895953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:05.897436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:51:05.913358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:05.914728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:51:05.915885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 644/1271] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:05.922213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:05.986568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:06.039510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338619ca-2e39-4cf8-b9e2-a22a20f602f1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:06.079438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5912bcc-713c-4dd2-a330-214fd451774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:06.080067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5912bcc-713c-4dd2-a330-214fd451774b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:06.080378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5912bcc-713c-4dd2-a330-214fd451774b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:06.080636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5912bcc-713c-4dd2-a330-214fd451774b None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:06.081331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5912bcc-713c-4dd2-a330-214fd451774b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:06.081644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5912bcc-713c-4dd2-a330-214fd451774b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:06.083133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5912bcc-713c-4dd2-a330-214fd451774b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:06.098150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 628/1272] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:06.105415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:06.224006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:06.233140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da886a-974f-4ad9-9f12-793c7ec3ad12 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:06.270115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e1bb3-b958-426a-8c1d-2a938cb10f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:06.270797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1bb3-b958-426a-8c1d-2a938cb10f1c None admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:06.271077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1bb3-b958-426a-8c1d-2a938cb10f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:06.271352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e1bb3-b958-426a-8c1d-2a938cb10f1c None admin] PATH_INFO: `/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/75d6d17c6b22402ca39158a737027f11/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:06.273410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1bb3-b958-426a-8c1d-2a938cb10f1c None admin] RBAC: Authorizing `identity:create_grant(project_id=c8fb36899b414894804cf9b6d5148c9a, user_id=75d6d17c6b22402ca39158a737027f11, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:06.275130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e1bb3-b958-426a-8c1d-2a938cb10f1c None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:06.289727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 645/1273] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Sep 14 12:51:06 2022] PUT /identity/v3/projects/c8fb36899b414894804cf9b6d5148c9a/users/75d6d17c6b22402ca39158a737027f11/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:51:08.538574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10853a-d42f-4fe5-be4e-1519dd5c7291 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:08.539149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10853a-d42f-4fe5-be4e-1519dd5c7291 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:08.539149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10853a-d42f-4fe5-be4e-1519dd5c7291 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:08.540485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 629/1274] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:51:08.546030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024489-bddc-4248-a749-c6129d1fc6b8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:08.546541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024489-bddc-4248-a749-c6129d1fc6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:08.546729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024489-bddc-4248-a749-c6129d1fc6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:08.565728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-87024489-bddc-4248-a749-c6129d1fc6b8 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:51:08.566937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-87024489-bddc-4248-a749-c6129d1fc6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:51:08.645453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 646/1275] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:51:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:51:08.926503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10853a-d42f-4fe5-be4e-1519dd5c7291 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:09.059923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10853a-d42f-4fe5-be4e-1519dd5c7291 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:09.082647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:09.100699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:09.101388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:09.101700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:09.102028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:09.113720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 14 12:51:09.118491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:09.119785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:09.120713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 630/1276] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Sep 14 12:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:09.127135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87024489-bddc-4248-a749-c6129d1fc6b8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:09.221564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:09.253741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87024489-bddc-4248-a749-c6129d1fc6b8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:09.301587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:09.302583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:09.303051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:09.303526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:09.304493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:09.304803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:09.306260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:09.316562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 647/1277] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Sep 14 12:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:09.323421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:09.461379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a05fab-dee6-47ee-848e-ae78991036c7 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:09.510462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:09.510990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:09.511263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:09.511544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:09.524781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:09.526270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:51:09.543718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:09.546295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:51:09.547437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:51:09.547437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:09.547437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:09.547437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 631/1278] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:51:09.551428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:09.706797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6068d7-200b-46e9-a4e8-d5ff126e4f40 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:09.747324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:09.747950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:09.748256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:09.748529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:09.749718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:09.750067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:09.751563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:09.767712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 648/1279] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:51:09.774317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:09.814975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:09.912496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43acd0-9d47-4fe2-8aaf-94383c978c5b None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:09.952868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:09.953588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:09.953869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:09.954359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] PATH_INFO: `/v3/users/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:09.962681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:09.964239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 14 12:51:09.976716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:09.978556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:09.980440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 632/1280] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:51:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:51:09.984921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:09.990059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:10.103588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5886ac-85df-4613-a247-434ab274f2df None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:10.142045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:10.142665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:10.142944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:10.143211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:10.143950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:10.144299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:10.145747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:10.168728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 649/1281] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Sep 14 12:51:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:10.175845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:10.292855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:10.304880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49c317-7162-4d8f-8a89-29c7ab1a8fde None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:10.344551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:10.345435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:10.345435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:10.345676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:10.424346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:10.425987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:10.558936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:10.572368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 633/1282] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Sep 14 12:51:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 14 12:51:10.579333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:10.677241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:10.741826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6670b8-12a0-42de-803c-8fed5f47796f None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:10.797576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:10.798220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:10.798500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:10.798820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:10.810243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:10.812352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 14 12:51:10.829418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:10.830823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 14 12:51:10.831941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 14 12:51:10.831941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 14 12:51:10.831941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:51:10.831941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 650/1283] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 14 12:51:10.839512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:10.983915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8066-320d-4da5-ae65-26de0755a600 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:11.039963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:11.040860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:11.041359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:11.041818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:11.042862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:11.043184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:11.045429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:11.062686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 634/1284] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Sep 14 12:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:51:11.072961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:11.225590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a911a-7286-4432-8aa2-af399839b374 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:11.251383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:11.291728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:11.292773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:11.293262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:11.293697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:11.309645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:11.316943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 14 12:51:11.343886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:11.345516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: ERROR keystone.server.flask.application Sep 14 12:51:11.346916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 651/1285] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Sep 14 12:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:11.354782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:11.452432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:11.556229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f8479-434e-4d5e-916e-3178f3d9e511 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:11.639041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69c833-27da-46f9-8ca1-41ce0d5b2f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:11.639041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69c833-27da-46f9-8ca1-41ce0d5b2f70 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:11.639041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69c833-27da-46f9-8ca1-41ce0d5b2f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:11.639041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69c833-27da-46f9-8ca1-41ce0d5b2f70 None admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:11.647417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69c833-27da-46f9-8ca1-41ce0d5b2f70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:11.647417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69c833-27da-46f9-8ca1-41ce0d5b2f70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:11.647417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69c833-27da-46f9-8ca1-41ce0d5b2f70 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:11.666339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 635/1286] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Sep 14 12:51:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:11.675747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:11.857155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963c2f7-caba-4042-82d7-2620a1071151 None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:11.910091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db120e-b302-4f53-99c0-332761f92a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:11.910712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db120e-b302-4f53-99c0-332761f92a71 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:11.910992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db120e-b302-4f53-99c0-332761f92a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:11.911294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db120e-b302-4f53-99c0-332761f92a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:11.912084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db120e-b302-4f53-99c0-332761f92a71 None admin] RBAC: Adding query filter params (role.id=66e1dbd98a0b4a9b8662169cd6c2433f, scope.project.id=c8fb36899b414894804cf9b6d5148c9a, user.id=75d6d17c6b22402ca39158a737027f11) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:11.912418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db120e-b302-4f53-99c0-332761f92a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:11.913800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db120e-b302-4f53-99c0-332761f92a71 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:11.925323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 652/1287] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Sep 14 12:51:11 2022] GET /identity/v3/role_assignments?user.id=75d6d17c6b22402ca39158a737027f11&scope.project.id=c8fb36899b414894804cf9b6d5148c9a&role.id=66e1dbd98a0b4a9b8662169cd6c2433f => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:14.303579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac86f0-a944-4eec-9a3d-8ffae74a3017 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:14.304225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac86f0-a944-4eec-9a3d-8ffae74a3017 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:14.304225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac86f0-a944-4eec-9a3d-8ffae74a3017 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:14.305605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 636/1288] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:51:14.311926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115cd96-d63c-468c-b475-c58ddefbb22b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:14.312698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115cd96-d63c-468c-b475-c58ddefbb22b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:14.312698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115cd96-d63c-468c-b475-c58ddefbb22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:14.335970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6115cd96-d63c-468c-b475-c58ddefbb22b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:51:14.337208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6115cd96-d63c-468c-b475-c58ddefbb22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:51:14.376101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:14.424331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 653/1289] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:51:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:51:14.712079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac86f0-a944-4eec-9a3d-8ffae74a3017 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:14.829234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac86f0-a944-4eec-9a3d-8ffae74a3017 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:14.840666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:14.868096 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:14.868644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:14.868921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:14.869193 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:14.869777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:14.871155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:14.880279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:14.882197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:14.883710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 637/1290] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:51:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:14.887651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115cd96-d63c-468c-b475-c58ddefbb22b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:15.012910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115cd96-d63c-468c-b475-c58ddefbb22b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:15.064769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca478408-6ef8-4f2b-83d0-5ab5cec8e34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:15.065635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478408-6ef8-4f2b-83d0-5ab5cec8e34a None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:15.065976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478408-6ef8-4f2b-83d0-5ab5cec8e34a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:15.066419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca478408-6ef8-4f2b-83d0-5ab5cec8e34a None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:15.067327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca478408-6ef8-4f2b-83d0-5ab5cec8e34a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:15.067800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca478408-6ef8-4f2b-83d0-5ab5cec8e34a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:15.070073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca478408-6ef8-4f2b-83d0-5ab5cec8e34a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:15.081216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 654/1291] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Sep 14 12:51:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:15.089478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:15.234470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d6e2c-639e-4b20-a48b-17d187ae92b4 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:15.285237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b5fff0-4e04-4b6f-9e95-5702065c6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:15.286188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5fff0-4e04-4b6f-9e95-5702065c6d72 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:15.286627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5fff0-4e04-4b6f-9e95-5702065c6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:15.287085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5fff0-4e04-4b6f-9e95-5702065c6d72 None admin] PATH_INFO: `/v3/services` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:15.288049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5fff0-4e04-4b6f-9e95-5702065c6d72 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:15.288400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5fff0-4e04-4b6f-9e95-5702065c6d72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:15.290297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b5fff0-4e04-4b6f-9e95-5702065c6d72 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:15.297031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 638/1292] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Sep 14 12:51:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:17.600691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944d15-cda3-4cd2-93a1-141fffc52669 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:17.601460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944d15-cda3-4cd2-93a1-141fffc52669 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:17.601460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75944d15-cda3-4cd2-93a1-141fffc52669 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:17.602679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 655/1293] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:51:17.610078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e375a4-30b0-4ae9-89b1-973a5b16fd89 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:17.610652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e375a4-30b0-4ae9-89b1-973a5b16fd89 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:17.611058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e375a4-30b0-4ae9-89b1-973a5b16fd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:17.637549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c1e375a4-30b0-4ae9-89b1-973a5b16fd89 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:51:17.638838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c1e375a4-30b0-4ae9-89b1-973a5b16fd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:51:17.681547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:17.737687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 639/1294] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:51:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:51:18.017315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75944d15-cda3-4cd2-93a1-141fffc52669 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:18.055257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:18.142758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75944d15-cda3-4cd2-93a1-141fffc52669 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:18.178960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59952f-6ace-433e-a8cf-2a614bf5984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:18.179564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59952f-6ace-433e-a8cf-2a614bf5984a None admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:18.179841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59952f-6ace-433e-a8cf-2a614bf5984a None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:18.180137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59952f-6ace-433e-a8cf-2a614bf5984a None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:18.180789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59952f-6ace-433e-a8cf-2a614bf5984a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:18.182160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59952f-6ace-433e-a8cf-2a614bf5984a None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:18.197754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 656/1295] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Sep 14 12:51:18 2022] POST /identity/v3/services => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 12:51:20.445461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd81d9-bb79-4c95-9346-682b568e348c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:20.446046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd81d9-bb79-4c95-9346-682b568e348c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:20.446046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd81d9-bb79-4c95-9346-682b568e348c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:20.447316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 640/1296] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:51:20.453632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70813960-9f5e-4501-90f0-ffc4f5f5aad6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:20.453632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70813960-9f5e-4501-90f0-ffc4f5f5aad6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:20.453632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70813960-9f5e-4501-90f0-ffc4f5f5aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:20.471232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-70813960-9f5e-4501-90f0-ffc4f5f5aad6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:51:20.472461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-70813960-9f5e-4501-90f0-ffc4f5f5aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:51:20.546267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 657/1297] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:51:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:51:20.818133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd81d9-bb79-4c95-9346-682b568e348c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:20.919514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd81d9-bb79-4c95-9346-682b568e348c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:20.954189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:20.954802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:20.955078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:20.955347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:20.955918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:20.957310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:20.965975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:20.967944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:20.969371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 641/1298] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:51:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:20.973944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70813960-9f5e-4501-90f0-ffc4f5f5aad6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:20.992997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:21.075903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70813960-9f5e-4501-90f0-ffc4f5f5aad6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:21.110175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:21.110775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:21.111054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:21.111328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:21.111974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:21.112311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:21.113676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:21.118761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 658/1299] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Sep 14 12:51:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:51:21.125035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:21.168006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:21.237936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a915781-c19f-49e1-adbf-0385b4b084f1 None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:21.272334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafab1b-4f3b-4aa3-a6be-eaf6cf3d7722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:21.272929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafab1b-4f3b-4aa3-a6be-eaf6cf3d7722 None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:21.273204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafab1b-4f3b-4aa3-a6be-eaf6cf3d7722 None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:21.273738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafab1b-4f3b-4aa3-a6be-eaf6cf3d7722 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:21.274423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafab1b-4f3b-4aa3-a6be-eaf6cf3d7722 None admin] RBAC: Adding query filter params (interface=public, service_id=1e9d51ac57b44f5f8c37ed0efe686c7a, region_id=RegionOne) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:21.274727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafab1b-4f3b-4aa3-a6be-eaf6cf3d7722 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:21.276109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafab1b-4f3b-4aa3-a6be-eaf6cf3d7722 None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:21.281973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 642/1300] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Sep 14 12:51:21 2022] GET /identity/v3/endpoints?service_id=1e9d51ac57b44f5f8c37ed0efe686c7a&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 12:51:21.287685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:21.367221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:21.385555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6fa87-8eab-4c2e-bb5b-ada0fb5d0faf None admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:21.421237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281c400-0d1c-4360-a1d0-42f1e8198dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:21.421839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c400-0d1c-4360-a1d0-42f1e8198dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:21.422116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c400-0d1c-4360-a1d0-42f1e8198dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:21.422390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281c400-0d1c-4360-a1d0-42f1e8198dd6 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:21.422997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281c400-0d1c-4360-a1d0-42f1e8198dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:21.424388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281c400-0d1c-4360-a1d0-42f1e8198dd6 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:21.431144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 659/1301] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Sep 14 12:51:21 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:51:23.600531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939113b-dfee-45e6-8ee2-ce00089db475 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:23.601179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939113b-dfee-45e6-8ee2-ce00089db475 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:23.601179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939113b-dfee-45e6-8ee2-ce00089db475 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:23.602401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 643/1302] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:51:23.607839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece6da7-439f-4a2b-9b4a-5e5439214d77 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:23.608382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece6da7-439f-4a2b-9b4a-5e5439214d77 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:23.608717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece6da7-439f-4a2b-9b4a-5e5439214d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:23.626795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cece6da7-439f-4a2b-9b4a-5e5439214d77 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:51:23.627979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cece6da7-439f-4a2b-9b4a-5e5439214d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:51:23.694666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 660/1303] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:51:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 14 12:51:23.959793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939113b-dfee-45e6-8ee2-ce00089db475 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:24.054621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:24.062341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939113b-dfee-45e6-8ee2-ce00089db475 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:24.098657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda184-f041-468a-8e9c-9800737865de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:24.099275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda184-f041-468a-8e9c-9800737865de None admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:24.099548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda184-f041-468a-8e9c-9800737865de None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:24.099814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eda184-f041-468a-8e9c-9800737865de None admin] PATH_INFO: `/v3/services/placement` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:24.100412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eda184-f041-468a-8e9c-9800737865de None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:24.101754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eda184-f041-468a-8e9c-9800737865de None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application [None req-46eda184-f041-468a-8e9c-9800737865de None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 14 12:51:24.110827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 14 12:51:24.112179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.get_or_create( Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application with Lock( Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self._enter() Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application return self.creator() Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application created_value = creator( Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: ERROR keystone.server.flask.application Sep 14 12:51:24.113396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 644/1304] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Sep 14 12:51:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 14 12:51:24.118070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece6da7-439f-4a2b-9b4a-5e5439214d77 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:24.196524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:24.219711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece6da7-439f-4a2b-9b4a-5e5439214d77 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:24.257882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367250ce-6b20-4617-96f1-33e880df96e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:24.258484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367250ce-6b20-4617-96f1-33e880df96e3 None admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:24.258764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367250ce-6b20-4617-96f1-33e880df96e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:24.259039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367250ce-6b20-4617-96f1-33e880df96e3 None admin] PATH_INFO: `/v3/services` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:24.259662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367250ce-6b20-4617-96f1-33e880df96e3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:51:24.259965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367250ce-6b20-4617-96f1-33e880df96e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:24.261381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367250ce-6b20-4617-96f1-33e880df96e3 None admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:24.266627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 661/1305] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Sep 14 12:51:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:51:24.272487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda184-f041-468a-8e9c-9800737865de None admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:51:24.371671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eda184-f041-468a-8e9c-9800737865de None admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:51:24.405774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a67908-1692-4f97-b0e2-164ba490586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:51:24.406377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a67908-1692-4f97-b0e2-164ba490586b None admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:51:24.406655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a67908-1692-4f97-b0e2-164ba490586b None admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:51:24.406925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a67908-1692-4f97-b0e2-164ba490586b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:51:24.407646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a67908-1692-4f97-b0e2-164ba490586b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:51:24.408980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a67908-1692-4f97-b0e2-164ba490586b None admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:51:24.429990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 645/1306] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:51:24 2022] POST /identity/v3/endpoints => generated 331 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:51:34.264786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=30 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:51:34.425383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:32.956195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69d60-443e-4c35-91c7-6a5728fcdc21 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:32.956667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69d60-443e-4c35-91c7-6a5728fcdc21 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:32.956759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be69d60-443e-4c35-91c7-6a5728fcdc21 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:32.963963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b7cf-8cda-493e-8c6e-cfb2fb5cc6a8 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:32.964474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b7cf-8cda-493e-8c6e-cfb2fb5cc6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:32.964699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304b7cf-8cda-493e-8c6e-cfb2fb5cc6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:32.969179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 662/1307] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:32 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:33.105549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5304b7cf-8cda-493e-8c6e-cfb2fb5cc6a8 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:33.108444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5304b7cf-8cda-493e-8c6e-cfb2fb5cc6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:33.253620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 646/1308] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:52:33.779627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e449-ba37-4e94-bfec-eb091a2656f5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:33.779988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e449-ba37-4e94-bfec-eb091a2656f5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:33.780232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471e449-ba37-4e94-bfec-eb091a2656f5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:33.781804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 663/1309] 10.222.0.50 () {54 vars in 965 bytes} [Wed Sep 14 12:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:33.788168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfb9e0-22f8-4cb3-9068-e04a61026c52 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:33.788535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfb9e0-22f8-4cb3-9068-e04a61026c52 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:33.788883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfb9e0-22f8-4cb3-9068-e04a61026c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:33.883970 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-35bfb9e0-22f8-4cb3-9068-e04a61026c52 None None] MFA Rules not processed for user `f5ca117fa96d412e9bda506591a01fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:33.885248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-35bfb9e0-22f8-4cb3-9068-e04a61026c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:33.911526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:33.978132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 647/1310] 10.222.0.50 () {58 vars in 1062 bytes} [Wed Sep 14 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:33.988688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471e449-ba37-4e94-bfec-eb091a2656f5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:33.990442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0471e449-ba37-4e94-bfec-eb091a2656f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:34.139171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471e449-ba37-4e94-bfec-eb091a2656f5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:34.232766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b7dbd-abd1-4fc7-98e8-6dd897a9be39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:34.233381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7dbd-abd1-4fc7-98e8-6dd897a9be39 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:34.233657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7dbd-abd1-4fc7-98e8-6dd897a9be39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:34.233926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b7dbd-abd1-4fc7-98e8-6dd897a9be39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:34.235581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c2b7dbd-abd1-4fc7-98e8-6dd897a9be39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:34.304099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:34.403417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b7dbd-abd1-4fc7-98e8-6dd897a9be39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:34.405268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b7dbd-abd1-4fc7-98e8-6dd897a9be39 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:34.441090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 664/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:52:37.282455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211780d-0e40-4c3d-bc34-0197ca80d24f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:37.283003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211780d-0e40-4c3d-bc34-0197ca80d24f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:37.283120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211780d-0e40-4c3d-bc34-0197ca80d24f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:37.284754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 648/1312] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:37.291291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332cbf-e89c-41c3-8369-d13f41650e8d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:37.292905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332cbf-e89c-41c3-8369-d13f41650e8d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:37.292905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e332cbf-e89c-41c3-8369-d13f41650e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:37.382305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5e332cbf-e89c-41c3-8369-d13f41650e8d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:37.383530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e332cbf-e89c-41c3-8369-d13f41650e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:37.498241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 665/1313] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:37.793716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211780d-0e40-4c3d-bc34-0197ca80d24f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:37.795248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0211780d-0e40-4c3d-bc34-0197ca80d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:37.913750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211780d-0e40-4c3d-bc34-0197ca80d24f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:37.991526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:37.994048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d37e5-fe32-4a71-88e2-f085529baee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:37.994722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d37e5-fe32-4a71-88e2-f085529baee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:37.995287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d37e5-fe32-4a71-88e2-f085529baee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:37.995902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d37e5-fe32-4a71-88e2-f085529baee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:37.997733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ee6d37e5-fe32-4a71-88e2-f085529baee5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:38.118118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d37e5-fe32-4a71-88e2-f085529baee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:38.119484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d37e5-fe32-4a71-88e2-f085529baee5 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:38.144994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 649/1314] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:52:40.758139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd8db-9c0f-4ee1-96ab-7aa867a409b5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:40.758971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd8db-9c0f-4ee1-96ab-7aa867a409b5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:40.758971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdd8db-9c0f-4ee1-96ab-7aa867a409b5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:40.760029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 666/1315] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:40.766383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c423aaa-c3c6-4bb1-8c3b-554bf58c83d1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:40.766904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c423aaa-c3c6-4bb1-8c3b-554bf58c83d1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:40.766904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c423aaa-c3c6-4bb1-8c3b-554bf58c83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:40.854918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3c423aaa-c3c6-4bb1-8c3b-554bf58c83d1 None None] MFA Rules not processed for user `90a2d633b13745feaca9fcbc613a1b38`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:40.856111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3c423aaa-c3c6-4bb1-8c3b-554bf58c83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:40.923331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:40.974806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 650/1316] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:41.269950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd8db-9c0f-4ee1-96ab-7aa867a409b5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:41.271526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-28fdd8db-9c0f-4ee1-96ab-7aa867a409b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:41.282366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:41.388888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdd8db-9c0f-4ee1-96ab-7aa867a409b5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:41.478254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bc64a-76c8-4a35-8d1d-d0e240f5c34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:41.478919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc64a-76c8-4a35-8d1d-d0e240f5c34d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:41.479390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc64a-76c8-4a35-8d1d-d0e240f5c34d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:41.479824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bc64a-76c8-4a35-8d1d-d0e240f5c34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:41.482161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-361bc64a-76c8-4a35-8d1d-d0e240f5c34d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:41.550974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:41.607838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bc64a-76c8-4a35-8d1d-d0e240f5c34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:41.609323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361bc64a-76c8-4a35-8d1d-d0e240f5c34d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:41.633710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 667/1317] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:52:44.592384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d84f-c4c7-4502-b894-41c07da44eb9 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:44.593186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d84f-c4c7-4502-b894-41c07da44eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:44.593334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d84f-c4c7-4502-b894-41c07da44eb9 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:44.595753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 651/1318] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:44.601968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05aae5-d60c-4556-bd87-4f6c08d087f6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:44.602544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05aae5-d60c-4556-bd87-4f6c08d087f6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:44.602544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05aae5-d60c-4556-bd87-4f6c08d087f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:44.682784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2b05aae5-d60c-4556-bd87-4f6c08d087f6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:44.684182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b05aae5-d60c-4556-bd87-4f6c08d087f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:44.796047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 668/1319] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:45.089706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661d84f-c4c7-4502-b894-41c07da44eb9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:45.091254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5661d84f-c4c7-4502-b894-41c07da44eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:45.230047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661d84f-c4c7-4502-b894-41c07da44eb9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:45.335154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0951d2-8c33-41de-bbf3-69099fcc82c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:45.335663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0951d2-8c33-41de-bbf3-69099fcc82c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:45.335938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0951d2-8c33-41de-bbf3-69099fcc82c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:45.336236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0951d2-8c33-41de-bbf3-69099fcc82c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:45.337876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4e0951d2-8c33-41de-bbf3-69099fcc82c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:45.345766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:45.479383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0951d2-8c33-41de-bbf3-69099fcc82c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:45.482391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0951d2-8c33-41de-bbf3-69099fcc82c4 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:45.516598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 652/1320] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:52:48.789124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db2e6-033a-4cda-9f72-534ba9e8c009 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:48.789679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db2e6-033a-4cda-9f72-534ba9e8c009 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:48.789679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db2e6-033a-4cda-9f72-534ba9e8c009 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:48.791064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 669/1321] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:48.798094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7e28-2742-45e8-b8f4-e85314b17899 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:48.798644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7e28-2742-45e8-b8f4-e85314b17899 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:48.798644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b7e28-2742-45e8-b8f4-e85314b17899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:48.882424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a25b7e28-2742-45e8-b8f4-e85314b17899 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:48.883658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a25b7e28-2742-45e8-b8f4-e85314b17899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:48.962956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:49.020456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 653/1322] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:49.317350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db2e6-033a-4cda-9f72-534ba9e8c009 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:49.318935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf9db2e6-033a-4cda-9f72-534ba9e8c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:49.341672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:49.443501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db2e6-033a-4cda-9f72-534ba9e8c009 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:49.530051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7c53-7a92-4bca-ac4e-16c9e1570bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:49.530839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7c53-7a92-4bca-ac4e-16c9e1570bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:49.531314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7c53-7a92-4bca-ac4e-16c9e1570bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:49.531801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7c53-7a92-4bca-ac4e-16c9e1570bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:49.534720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c0b7c53-7a92-4bca-ac4e-16c9e1570bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:49.630301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:49.683553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7c53-7a92-4bca-ac4e-16c9e1570bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:49.685299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7c53-7a92-4bca-ac4e-16c9e1570bd3 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:49.707570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 670/1323] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:52:52.020936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0e33-fc3a-4b5c-a1e1-3d99ad282b37 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:52.021665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0e33-fc3a-4b5c-a1e1-3d99ad282b37 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:52.021665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b0e33-fc3a-4b5c-a1e1-3d99ad282b37 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:52.023197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 654/1324] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:52.030019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4497-81ef-42d9-bfca-bdc57d197e20 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:52.031432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4497-81ef-42d9-bfca-bdc57d197e20 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:52.031432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e4497-81ef-42d9-bfca-bdc57d197e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:52.110013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f60e4497-81ef-42d9-bfca-bdc57d197e20 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:52.111241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f60e4497-81ef-42d9-bfca-bdc57d197e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:52.225385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 671/1325] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:52.514545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b0e33-fc3a-4b5c-a1e1-3d99ad282b37 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:52.516153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-077b0e33-fc3a-4b5c-a1e1-3d99ad282b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:52.633729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b0e33-fc3a-4b5c-a1e1-3d99ad282b37 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:52.721659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46d1dc-5359-475c-b11a-148b455c15b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:52.722261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46d1dc-5359-475c-b11a-148b455c15b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:52.722531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46d1dc-5359-475c-b11a-148b455c15b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:52.722794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46d1dc-5359-475c-b11a-148b455c15b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:52.724394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ca46d1dc-5359-475c-b11a-148b455c15b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:52.743086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:52.845764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46d1dc-5359-475c-b11a-148b455c15b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:52.847116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46d1dc-5359-475c-b11a-148b455c15b5 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:52.867260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 655/1326] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:52:55.349083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094bb38-b923-4187-8148-f648be47e3a2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:55.349645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094bb38-b923-4187-8148-f648be47e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:55.349645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094bb38-b923-4187-8148-f648be47e3a2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:55.350927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 672/1327] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:55.356339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702098c-818b-4fdf-9efd-41f81b2b6d5a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:55.356796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702098c-818b-4fdf-9efd-41f81b2b6d5a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:55.356923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702098c-818b-4fdf-9efd-41f81b2b6d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:55.438428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3702098c-818b-4fdf-9efd-41f81b2b6d5a None None] MFA Rules not processed for user `90a2d633b13745feaca9fcbc613a1b38`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:55.439614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3702098c-818b-4fdf-9efd-41f81b2b6d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:55.507665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:55.543732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 656/1328] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:55.841951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094bb38-b923-4187-8148-f648be47e3a2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:55.843568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6094bb38-b923-4187-8148-f648be47e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:55.877910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:55.959343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094bb38-b923-4187-8148-f648be47e3a2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:56.039001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139ff76-3692-4b2c-8177-ea4a1c0bfb80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:56.039609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ff76-3692-4b2c-8177-ea4a1c0bfb80 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:56.039888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ff76-3692-4b2c-8177-ea4a1c0bfb80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:56.040193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139ff76-3692-4b2c-8177-ea4a1c0bfb80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:56.041848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f139ff76-3692-4b2c-8177-ea4a1c0bfb80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:56.125195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:56.159935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139ff76-3692-4b2c-8177-ea4a1c0bfb80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:56.161400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139ff76-3692-4b2c-8177-ea4a1c0bfb80 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:56.179615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 673/1329] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:52:59.067201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68fad-4f82-4dae-bd66-8b5a30f2698a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:59.067743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68fad-4f82-4dae-bd66-8b5a30f2698a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:59.067743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c68fad-4f82-4dae-bd66-8b5a30f2698a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:59.069102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 657/1330] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:52:59.074703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82babf11-1ca7-45a0-a20c-097c575596e1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:59.075179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82babf11-1ca7-45a0-a20c-097c575596e1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:59.075272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82babf11-1ca7-45a0-a20c-097c575596e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:59.142314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-82babf11-1ca7-45a0-a20c-097c575596e1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:52:59.143509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-82babf11-1ca7-45a0-a20c-097c575596e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:59.248582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 674/1331] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:52:59.541782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68fad-4f82-4dae-bd66-8b5a30f2698a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:52:59.543304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d0c68fad-4f82-4dae-bd66-8b5a30f2698a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:59.655040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c68fad-4f82-4dae-bd66-8b5a30f2698a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:52:59.747653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc1e28-ad21-4260-9760-3db726e85e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:52:59.748282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1e28-ad21-4260-9760-3db726e85e06 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:52:59.748557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1e28-ad21-4260-9760-3db726e85e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:52:59.748822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc1e28-ad21-4260-9760-3db726e85e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:52:59.750413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-41dc1e28-ad21-4260-9760-3db726e85e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:52:59.778004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:52:59.865310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc1e28-ad21-4260-9760-3db726e85e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:52:59.866751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc1e28-ad21-4260-9760-3db726e85e06 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:52:59.885486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 658/1332] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:02.170991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff356-ae98-47c7-a9a7-e8df8f5ee623 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:02.171592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff356-ae98-47c7-a9a7-e8df8f5ee623 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:02.171592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fff356-ae98-47c7-a9a7-e8df8f5ee623 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:02.172932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 675/1333] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:02.179085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35affe7-98bc-4210-9e29-b0a59175e04b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:02.179672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35affe7-98bc-4210-9e29-b0a59175e04b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:02.179672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35affe7-98bc-4210-9e29-b0a59175e04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:02.257798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b35affe7-98bc-4210-9e29-b0a59175e04b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:02.259014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b35affe7-98bc-4210-9e29-b0a59175e04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:02.375340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:02.403752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 659/1334] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:02.734834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0df120-bf1e-4728-ad0a-f4f3135622ae None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:02.735106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0df120-bf1e-4728-ad0a-f4f3135622ae None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:02.735373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0df120-bf1e-4728-ad0a-f4f3135622ae None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:02.736767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 676/1335] 10.222.0.50 () {54 vars in 965 bytes} [Wed Sep 14 12:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:02.744093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e67f2-f945-43bd-b326-537808f76086 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:02.744385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e67f2-f945-43bd-b326-537808f76086 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:02.744664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e67f2-f945-43bd-b326-537808f76086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:02.836941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f82e67f2-f945-43bd-b326-537808f76086 None None] MFA Rules not processed for user `f5ca117fa96d412e9bda506591a01fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:02.838307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f82e67f2-f945-43bd-b326-537808f76086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:02.934557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 660/1336] 10.222.0.50 () {58 vars in 1062 bytes} [Wed Sep 14 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:02.944220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0df120-bf1e-4728-ad0a-f4f3135622ae None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:02.945800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3e0df120-bf1e-4728-ad0a-f4f3135622ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:02.992700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:03.092635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0df120-bf1e-4728-ad0a-f4f3135622ae None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:03.178758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d84ec2-3f05-4012-8278-e471c27591ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:03.179657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84ec2-3f05-4012-8278-e471c27591ae service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:03.179657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84ec2-3f05-4012-8278-e471c27591ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:03.179900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d84ec2-3f05-4012-8278-e471c27591ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:03.182287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-20d84ec2-3f05-4012-8278-e471c27591ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:03.273182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:03.301575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d84ec2-3f05-4012-8278-e471c27591ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:03.303079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d84ec2-3f05-4012-8278-e471c27591ae service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:03.322561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 677/1337] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:06.554511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c8a6c-91d3-4dae-8b10-a49ab6cc45e5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:06.554994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c8a6c-91d3-4dae-8b10-a49ab6cc45e5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:06.555120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c8a6c-91d3-4dae-8b10-a49ab6cc45e5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:06.557114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 661/1338] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:06.562872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6ca65-2b67-4048-b8bb-b0f533601703 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:06.563314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6ca65-2b67-4048-b8bb-b0f533601703 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:06.563433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6ca65-2b67-4048-b8bb-b0f533601703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:06.630132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aaf6ca65-2b67-4048-b8bb-b0f533601703 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:06.631337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aaf6ca65-2b67-4048-b8bb-b0f533601703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:06.732737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 678/1339] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:07.018324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c8a6c-91d3-4dae-8b10-a49ab6cc45e5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:07.020119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c44c8a6c-91d3-4dae-8b10-a49ab6cc45e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:07.113677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:07.143023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c8a6c-91d3-4dae-8b10-a49ab6cc45e5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:07.218863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b57dec-145b-4071-b849-8b1882024a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:07.219472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b57dec-145b-4071-b849-8b1882024a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:07.219765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b57dec-145b-4071-b849-8b1882024a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:07.220052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b57dec-145b-4071-b849-8b1882024a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:07.221642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c5b57dec-145b-4071-b849-8b1882024a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:07.337425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b57dec-145b-4071-b849-8b1882024a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:07.339011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b57dec-145b-4071-b849-8b1882024a53 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:07.357038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 662/1340] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:11.815164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a217-ecfa-493e-bbd1-aa60cd4d973e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:11.815746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a217-ecfa-493e-bbd1-aa60cd4d973e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:11.816186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560a217-ecfa-493e-bbd1-aa60cd4d973e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:11.819324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 679/1341] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:11.825165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ab10c-a063-4145-b220-bd9c9901a023 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:11.825760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ab10c-a063-4145-b220-bd9c9901a023 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:11.825760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ab10c-a063-4145-b220-bd9c9901a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:11.831205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:11.917065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a51ab10c-a063-4145-b220-bd9c9901a023 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:11.918394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a51ab10c-a063-4145-b220-bd9c9901a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:12.044056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 663/1342] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:53:12.404716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560a217-ecfa-493e-bbd1-aa60cd4d973e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:12.407075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6560a217-ecfa-493e-bbd1-aa60cd4d973e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:12.493121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:12.583719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560a217-ecfa-493e-bbd1-aa60cd4d973e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:12.683145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d90433-28a3-4949-bbc4-fbb09b6a8aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:12.684062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90433-28a3-4949-bbc4-fbb09b6a8aba service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:12.684698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90433-28a3-4949-bbc4-fbb09b6a8aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:12.685145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d90433-28a3-4949-bbc4-fbb09b6a8aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:12.687058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-82d90433-28a3-4949-bbc4-fbb09b6a8aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:12.833999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:12.867447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90433-28a3-4949-bbc4-fbb09b6a8aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:12.869350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d90433-28a3-4949-bbc4-fbb09b6a8aba service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:12.891758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 680/1343] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:15.961267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e47e0-1e17-4238-a64f-ada96f7f08e5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:15.961823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e47e0-1e17-4238-a64f-ada96f7f08e5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:15.961823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e47e0-1e17-4238-a64f-ada96f7f08e5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:15.963436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 664/1344] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:15.969019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925117a1-20de-4d94-8e69-33acb280ab15 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:15.969528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925117a1-20de-4d94-8e69-33acb280ab15 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:15.969625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925117a1-20de-4d94-8e69-33acb280ab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:16.064184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-925117a1-20de-4d94-8e69-33acb280ab15 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:16.065455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-925117a1-20de-4d94-8e69-33acb280ab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:16.176449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 681/1345] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:53:16.473010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e47e0-1e17-4238-a64f-ada96f7f08e5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:16.488230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9e3e47e0-1e17-4238-a64f-ada96f7f08e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:16.594455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:16.618516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e47e0-1e17-4238-a64f-ada96f7f08e5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:16.717710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01777-8653-473e-b04a-a17cd9e145b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:16.718331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01777-8653-473e-b04a-a17cd9e145b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:16.718607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01777-8653-473e-b04a-a17cd9e145b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:16.718876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01777-8653-473e-b04a-a17cd9e145b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:16.720529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-15d01777-8653-473e-b04a-a17cd9e145b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:16.883207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01777-8653-473e-b04a-a17cd9e145b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:16.885615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d01777-8653-473e-b04a-a17cd9e145b1 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:16.911582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 665/1346] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:21.488778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c76dc-6c53-4dc2-8865-e0ac5000e143 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:21.489293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c76dc-6c53-4dc2-8865-e0ac5000e143 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:21.489386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c76dc-6c53-4dc2-8865-e0ac5000e143 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:21.490862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 682/1347] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:21.497347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a98f2-4298-4b3a-8401-cef780418a9c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:21.498176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a98f2-4298-4b3a-8401-cef780418a9c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:21.498355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a98f2-4298-4b3a-8401-cef780418a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:21.520867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:21.584965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-522a98f2-4298-4b3a-8401-cef780418a9c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:21.586486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-522a98f2-4298-4b3a-8401-cef780418a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:21.699255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 666/1348] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:21.991939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c76dc-6c53-4dc2-8865-e0ac5000e143 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:21.993806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f1c76dc-6c53-4dc2-8865-e0ac5000e143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:22.058316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:22.108955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c76dc-6c53-4dc2-8865-e0ac5000e143 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:22.189036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbe673-776e-419a-af95-324230733d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:22.189642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbe673-776e-419a-af95-324230733d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:22.189919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbe673-776e-419a-af95-324230733d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:22.190194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbe673-776e-419a-af95-324230733d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:22.192099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4cbe673-776e-419a-af95-324230733d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:22.319385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:22.324974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbe673-776e-419a-af95-324230733d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:22.326437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbe673-776e-419a-af95-324230733d77 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:22.346665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 683/1349] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:27.719374 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cd2b-642c-4404-8bbc-3270d441f8c0 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:27.719917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cd2b-642c-4404-8bbc-3270d441f8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:27.720071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14cd2b-642c-4404-8bbc-3270d441f8c0 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:27.721608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 667/1350] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 12:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:27.727107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd70e4-8c8e-4ef5-983e-018009f201d3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:27.730319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd70e4-8c8e-4ef5-983e-018009f201d3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:27.730785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd70e4-8c8e-4ef5-983e-018009f201d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:27.854247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-11dd70e4-8c8e-4ef5-983e-018009f201d3 None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:27.855699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11dd70e4-8c8e-4ef5-983e-018009f201d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:27.996707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 684/1351] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:31.697556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=59 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:32.769499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c209-d023-4d05-bc8d-bbdf8bd7bac6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:32.770172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c209-d023-4d05-bc8d-bbdf8bd7bac6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:32.770172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4c209-d023-4d05-bc8d-bbdf8bd7bac6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:32.773139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 668/1352] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 12:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:53:32.781609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ed597-0241-4d6b-8762-b078aba702ef None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:32.782748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ed597-0241-4d6b-8762-b078aba702ef None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:32.783060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ed597-0241-4d6b-8762-b078aba702ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:32.871243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:32.934634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6c7ed597-0241-4d6b-8762-b078aba702ef None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:32.936043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6c7ed597-0241-4d6b-8762-b078aba702ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:33.146193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 685/1353] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:34.837377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355077-8a88-4549-8127-72931de2c979 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:34.838552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355077-8a88-4549-8127-72931de2c979 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:34.838921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355077-8a88-4549-8127-72931de2c979 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:34.841383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 669/1354] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 12:53:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:53:34.848117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9914-b2b4-420b-bf2d-efd2b6cf62e9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:34.849792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9914-b2b4-420b-bf2d-efd2b6cf62e9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:34.850609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae9914-b2b4-420b-bf2d-efd2b6cf62e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:34.968987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-58ae9914-b2b4-420b-bf2d-efd2b6cf62e9 None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:34.970194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-58ae9914-b2b4-420b-bf2d-efd2b6cf62e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:35.018104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:35.105534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 686/1355] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:38.895286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cc4e-7f55-4af5-93d8-f9d27cb7122e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:38.896192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cc4e-7f55-4af5-93d8-f9d27cb7122e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:38.896639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6cc4e-7f55-4af5-93d8-f9d27cb7122e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:38.898460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 670/1356] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:38.904611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a1e8-73be-44fc-9bdf-ec66cbe0a33c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:38.905455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a1e8-73be-44fc-9bdf-ec66cbe0a33c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:38.906776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a1e8-73be-44fc-9bdf-ec66cbe0a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:39.024318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7c74a1e8-73be-44fc-9bdf-ec66cbe0a33c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:39.029089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7c74a1e8-73be-44fc-9bdf-ec66cbe0a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:39.175516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 687/1357] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:39.489505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333e9c-17a4-4c8f-a7df-820227214537 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:39.490042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333e9c-17a4-4c8f-a7df-820227214537 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:39.490567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55333e9c-17a4-4c8f-a7df-820227214537 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:39.492774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 671/1358] 10.222.0.50 () {54 vars in 962 bytes} [Wed Sep 14 12:53:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:39.501178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2a119-71ec-4ac3-9e0e-e7d87e70376e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:39.501464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2a119-71ec-4ac3-9e0e-e7d87e70376e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:39.501745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2a119-71ec-4ac3-9e0e-e7d87e70376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:39.524471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:39.598863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7ea2a119-71ec-4ac3-9e0e-e7d87e70376e None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:39.600290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7ea2a119-71ec-4ac3-9e0e-e7d87e70376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:39.749570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 688/1359] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Sep 14 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:53:39.758835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333e9c-17a4-4c8f-a7df-820227214537 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:39.761027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-55333e9c-17a4-4c8f-a7df-820227214537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:39.941199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55333e9c-17a4-4c8f-a7df-820227214537 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:40.084394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:40.160262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465d3d3-d0ee-41ba-9ad0-8b359790d638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:40.161459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d3d3-d0ee-41ba-9ad0-8b359790d638 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:40.162024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d3d3-d0ee-41ba-9ad0-8b359790d638 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:40.162582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465d3d3-d0ee-41ba-9ad0-8b359790d638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:40.165537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0465d3d3-d0ee-41ba-9ad0-8b359790d638 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:40.314000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465d3d3-d0ee-41ba-9ad0-8b359790d638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:40.315976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465d3d3-d0ee-41ba-9ad0-8b359790d638 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:40.348214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 672/1360] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:43.094992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d96b0-85ce-45b8-b4d8-6ae3e2190adf None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:43.095559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d96b0-85ce-45b8-b4d8-6ae3e2190adf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:43.096825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92d96b0-85ce-45b8-b4d8-6ae3e2190adf None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:43.097760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 689/1361] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:43.103632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1197f-b584-4e64-8cbc-5d14de91f1cd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:43.104284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1197f-b584-4e64-8cbc-5d14de91f1cd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:43.104284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1197f-b584-4e64-8cbc-5d14de91f1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:43.194467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d4d1197f-b584-4e64-8cbc-5d14de91f1cd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:43.196437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4d1197f-b584-4e64-8cbc-5d14de91f1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:43.245091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:43.327451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 673/1362] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:43.645523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d96b0-85ce-45b8-b4d8-6ae3e2190adf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:43.647042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b92d96b0-85ce-45b8-b4d8-6ae3e2190adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:43.774573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:43.888055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92d96b0-85ce-45b8-b4d8-6ae3e2190adf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:44.051048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88366742-0439-4de2-a8ed-b24010399aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:44.051662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366742-0439-4de2-a8ed-b24010399aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:44.052349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366742-0439-4de2-a8ed-b24010399aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:44.052349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88366742-0439-4de2-a8ed-b24010399aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:44.053864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-88366742-0439-4de2-a8ed-b24010399aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:44.079780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:44.165656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88366742-0439-4de2-a8ed-b24010399aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:44.168324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88366742-0439-4de2-a8ed-b24010399aa3 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:44.192279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 690/1363] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:47.049959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3bf1-05aa-43d1-adcc-19d435eaf5be None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:47.050575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3bf1-05aa-43d1-adcc-19d435eaf5be None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:47.050779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eae3bf1-05aa-43d1-adcc-19d435eaf5be None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:47.053421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 674/1364] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:47.061224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa39011-2abc-4736-ba3d-23a93a122944 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:47.061779 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa39011-2abc-4736-ba3d-23a93a122944 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:47.062055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa39011-2abc-4736-ba3d-23a93a122944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:47.164644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6fa39011-2abc-4736-ba3d-23a93a122944 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:47.166425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6fa39011-2abc-4736-ba3d-23a93a122944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:47.333562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:47.344050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 691/1365] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:47.706538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca666f-14d4-4024-8e56-c55c49844ebe None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:47.707065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca666f-14d4-4024-8e56-c55c49844ebe None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:47.707593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca666f-14d4-4024-8e56-c55c49844ebe None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:47.709536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 675/1366] 10.222.0.50 () {54 vars in 962 bytes} [Wed Sep 14 12:53:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:47.720898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c42a8c-559b-4159-92fb-7c845779c7ab None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:47.721380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c42a8c-559b-4159-92fb-7c845779c7ab None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:47.721788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c42a8c-559b-4159-92fb-7c845779c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:47.833840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-11c42a8c-559b-4159-92fb-7c845779c7ab None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:47.835422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11c42a8c-559b-4159-92fb-7c845779c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:48.031213 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 692/1367] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Sep 14 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:48.043041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca666f-14d4-4024-8e56-c55c49844ebe None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:48.045123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-57ca666f-14d4-4024-8e56-c55c49844ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:48.304510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca666f-14d4-4024-8e56-c55c49844ebe None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:48.338797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:48.344289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670b33-c218-4c1f-8a5b-6efd2e005b6b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:48.345075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670b33-c218-4c1f-8a5b-6efd2e005b6b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:48.345075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17670b33-c218-4c1f-8a5b-6efd2e005b6b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:48.346790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 693/1368] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:53:48.353401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42c02-980c-4e45-852a-5a80b51b8fa0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:48.354404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42c02-980c-4e45-852a-5a80b51b8fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:48.354809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42c02-980c-4e45-852a-5a80b51b8fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:48.445483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:48.462296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f1a42c02-980c-4e45-852a-5a80b51b8fa0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:48.465174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f1a42c02-980c-4e45-852a-5a80b51b8fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:48.502566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de642d13-91ad-4337-9dec-c67790fd789d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:48.504257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642d13-91ad-4337-9dec-c67790fd789d service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:48.504257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642d13-91ad-4337-9dec-c67790fd789d service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:48.504564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de642d13-91ad-4337-9dec-c67790fd789d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:48.506584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-de642d13-91ad-4337-9dec-c67790fd789d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:48.656681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642d13-91ad-4337-9dec-c67790fd789d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:48.658518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de642d13-91ad-4337-9dec-c67790fd789d service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:48.662803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 694/1369] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:53:48.695795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 676/1370] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:49.069625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751c01-6055-4c5b-aac6-93eb2d435353 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:49.069932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751c01-6055-4c5b-aac6-93eb2d435353 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:49.070208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751c01-6055-4c5b-aac6-93eb2d435353 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:49.072088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 695/1371] 10.222.0.50 () {54 vars in 964 bytes} [Wed Sep 14 12:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:49.080391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181195-2d4f-452f-bf26-b6e587c9bc7c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:49.080655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181195-2d4f-452f-bf26-b6e587c9bc7c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:49.080893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3181195-2d4f-452f-bf26-b6e587c9bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:49.134148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:49.211441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b3181195-2d4f-452f-bf26-b6e587c9bc7c None None] MFA Rules not processed for user `05fad60cd02c4c2295beb15783aecfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:49.213086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b3181195-2d4f-452f-bf26-b6e587c9bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:49.379363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 677/1372] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Sep 14 12:53:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:49.394921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751c01-6055-4c5b-aac6-93eb2d435353 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:49.397769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b8751c01-6055-4c5b-aac6-93eb2d435353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:49.574977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751c01-6055-4c5b-aac6-93eb2d435353 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:49.623539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:49.692812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcbbb-5a18-435f-8286-1726409578ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:49.693790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcbbb-5a18-435f-8286-1726409578ab service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:49.694069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcbbb-5a18-435f-8286-1726409578ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:49.694409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcbbb-5a18-435f-8286-1726409578ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:49.696347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-429dcbbb-5a18-435f-8286-1726409578ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:49.893891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dcbbb-5a18-435f-8286-1726409578ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:49.896616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dcbbb-5a18-435f-8286-1726409578ab service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:49.930348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 696/1373] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:51.363304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1b4ee-22d3-4114-aa87-6cead94054ba None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:51.363910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1b4ee-22d3-4114-aa87-6cead94054ba None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:51.363910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1b4ee-22d3-4114-aa87-6cead94054ba None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:51.365226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 678/1374] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:51.371495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5a52-d516-46a9-a05a-5ffc34293ef4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:51.372037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5a52-d516-46a9-a05a-5ffc34293ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:51.372185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d5a52-d516-46a9-a05a-5ffc34293ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:51.453275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c86d5a52-d516-46a9-a05a-5ffc34293ef4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:51.454708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c86d5a52-d516-46a9-a05a-5ffc34293ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:51.462129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:51.568300 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 697/1375] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:51.876692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1b4ee-22d3-4114-aa87-6cead94054ba None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:51.878342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5db1b4ee-22d3-4114-aa87-6cead94054ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:52.046698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:52.112137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1b4ee-22d3-4114-aa87-6cead94054ba None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:52.292908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c763596-c92f-470b-a492-d76334c77c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:52.293562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763596-c92f-470b-a492-d76334c77c89 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:52.293843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763596-c92f-470b-a492-d76334c77c89 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:52.294115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763596-c92f-470b-a492-d76334c77c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:52.295795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7c763596-c92f-470b-a492-d76334c77c89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:52.414364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:52.432051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c763596-c92f-470b-a492-d76334c77c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:52.433699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c763596-c92f-470b-a492-d76334c77c89 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:52.455379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 679/1376] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:55.015378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb855ee-0a7f-458c-9414-f87f0cc74466 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:55.016967 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb855ee-0a7f-458c-9414-f87f0cc74466 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:55.017479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb855ee-0a7f-458c-9414-f87f0cc74466 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:55.019561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 698/1377] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:55.027168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c53e8-4b47-4639-b80c-71ea462666c2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:55.028301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c53e8-4b47-4639-b80c-71ea462666c2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:55.028301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c53e8-4b47-4639-b80c-71ea462666c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:55.116276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-613c53e8-4b47-4639-b80c-71ea462666c2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:55.117744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-613c53e8-4b47-4639-b80c-71ea462666c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:55.245735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 680/1378] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:55.562636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb855ee-0a7f-458c-9414-f87f0cc74466 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:55.564543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cbb855ee-0a7f-458c-9414-f87f0cc74466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:55.759096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:55.775664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb855ee-0a7f-458c-9414-f87f0cc74466 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:55.954803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc12ad03-5318-4b62-bfa9-b68c047b1ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:55.956692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ad03-5318-4b62-bfa9-b68c047b1ec3 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:55.957291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ad03-5318-4b62-bfa9-b68c047b1ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:55.958041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc12ad03-5318-4b62-bfa9-b68c047b1ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:55.961270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cc12ad03-5318-4b62-bfa9-b68c047b1ec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:56.102191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ad03-5318-4b62-bfa9-b68c047b1ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:56.104236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc12ad03-5318-4b62-bfa9-b68c047b1ec3 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:53:56.117390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:56.129787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 699/1379] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:53:58.869567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cdae-b622-422a-829c-3c1cb9f62e7a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:58.870192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cdae-b622-422a-829c-3c1cb9f62e7a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:58.870763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5cdae-b622-422a-829c-3c1cb9f62e7a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:58.877151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 681/1380] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:53:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:53:58.888721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431981b3-27a4-4ae7-8e07-c1203ad9a29b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:58.888721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431981b3-27a4-4ae7-8e07-c1203ad9a29b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:58.888721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431981b3-27a4-4ae7-8e07-c1203ad9a29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:59.029346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-431981b3-27a4-4ae7-8e07-c1203ad9a29b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:53:59.030851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-431981b3-27a4-4ae7-8e07-c1203ad9a29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:59.178956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 700/1381] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:53:59.494834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5cdae-b622-422a-829c-3c1cb9f62e7a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:53:59.497921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-35b5cdae-b622-422a-829c-3c1cb9f62e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:59.616044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:59.721307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5cdae-b622-422a-829c-3c1cb9f62e7a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:53:59.856141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9ab35-f036-442b-a8fa-f40516831a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:53:59.856754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9ab35-f036-442b-a8fa-f40516831a70 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:53:59.857041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9ab35-f036-442b-a8fa-f40516831a70 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:53:59.857308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9ab35-f036-442b-a8fa-f40516831a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:53:59.858936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-efe9ab35-f036-442b-a8fa-f40516831a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:53:59.879678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:53:59.987721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9ab35-f036-442b-a8fa-f40516831a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:53:59.989771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9ab35-f036-442b-a8fa-f40516831a70 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:00.018601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 682/1382] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:02.386687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5810b-9be0-43fa-a261-bead89b1a86f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:02.387282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5810b-9be0-43fa-a261-bead89b1a86f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:02.387282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5810b-9be0-43fa-a261-bead89b1a86f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:02.388629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 701/1383] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:02.399471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a63e-12be-4097-87a8-92e2153a9cfc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:02.400722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a63e-12be-4097-87a8-92e2153a9cfc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:02.400722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573a63e-12be-4097-87a8-92e2153a9cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:02.500382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9573a63e-12be-4097-87a8-92e2153a9cfc None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:02.501969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9573a63e-12be-4097-87a8-92e2153a9cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:02.649261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:02.661012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 683/1384] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:03.116833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5810b-9be0-43fa-a261-bead89b1a86f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:03.119758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c7a5810b-9be0-43fa-a261-bead89b1a86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:03.249279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:03.389623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5810b-9be0-43fa-a261-bead89b1a86f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:03.564158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aa690-da55-410a-b1d7-809124604011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:03.565018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa690-da55-410a-b1d7-809124604011 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:03.565424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa690-da55-410a-b1d7-809124604011 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:03.565802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa690-da55-410a-b1d7-809124604011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:03.568356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-338aa690-da55-410a-b1d7-809124604011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:03.646244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:03.731070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aa690-da55-410a-b1d7-809124604011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:03.733124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aa690-da55-410a-b1d7-809124604011 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:03.758841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 702/1385] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:06.060933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ab2b1-cb81-4236-9d5b-819be8a1ca0a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:06.061498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ab2b1-cb81-4236-9d5b-819be8a1ca0a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:06.061498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ab2b1-cb81-4236-9d5b-819be8a1ca0a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:06.062862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 684/1386] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:54:06.069100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cfd12-86ca-411e-adff-71ae9cc869e0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:06.069726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cfd12-86ca-411e-adff-71ae9cc869e0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:06.069726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cfd12-86ca-411e-adff-71ae9cc869e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:06.156296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-256cfd12-86ca-411e-adff-71ae9cc869e0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:06.157527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-256cfd12-86ca-411e-adff-71ae9cc869e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:06.298714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 703/1387] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:06.601395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ab2b1-cb81-4236-9d5b-819be8a1ca0a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:06.603063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-375ab2b1-cb81-4236-9d5b-819be8a1ca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:06.714446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d2446-e9d4-47ba-be18-d5e4f60eb408 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:06.714810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d2446-e9d4-47ba-be18-d5e4f60eb408 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:06.715159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d2446-e9d4-47ba-be18-d5e4f60eb408 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:06.716819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 704/1388] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:54:06.723259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751f831-12c0-46d7-84a9-59b064f71c59 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:06.723580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751f831-12c0-46d7-84a9-59b064f71c59 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:06.723867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751f831-12c0-46d7-84a9-59b064f71c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:06.745151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:06.805539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ab2b1-cb81-4236-9d5b-819be8a1ca0a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:06.810745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2751f831-12c0-46d7-84a9-59b064f71c59 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:06.811982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2751f831-12c0-46d7-84a9-59b064f71c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:06.888484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:06.941564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 705/1389] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:54:06.949749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4ccf-64ae-4e44-ba5a-d7c2b5014a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:06.950380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4ccf-64ae-4e44-ba5a-d7c2b5014a59 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:06.950665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4ccf-64ae-4e44-ba5a-d7c2b5014a59 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:06.950934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4ccf-64ae-4e44-ba5a-d7c2b5014a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:06.952737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-770f4ccf-64ae-4e44-ba5a-d7c2b5014a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:07.065768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4ccf-64ae-4e44-ba5a-d7c2b5014a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:07.067606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4ccf-64ae-4e44-ba5a-d7c2b5014a59 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:07.090873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 685/1390] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:07.281229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7ef49-0c2e-4720-a73e-55bd9b677764 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:07.282065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7ef49-0c2e-4720-a73e-55bd9b677764 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:07.282065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7ef49-0c2e-4720-a73e-55bd9b677764 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:07.283149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 706/1391] 10.222.0.50 () {54 vars in 966 bytes} [Wed Sep 14 12:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:07.289366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915096c-796a-4fda-a214-5aeaac61c37d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:07.289753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915096c-796a-4fda-a214-5aeaac61c37d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:07.289946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915096c-796a-4fda-a214-5aeaac61c37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:07.391347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d915096c-796a-4fda-a214-5aeaac61c37d None None] MFA Rules not processed for user `59b299d3239e4f53912477d94975d9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:07.392645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d915096c-796a-4fda-a214-5aeaac61c37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:07.420466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:07.488548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 686/1392] 10.222.0.50 () {58 vars in 1063 bytes} [Wed Sep 14 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:07.498246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7ef49-0c2e-4720-a73e-55bd9b677764 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:07.499771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-33a7ef49-0c2e-4720-a73e-55bd9b677764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:07.614233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:07.622995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7ef49-0c2e-4720-a73e-55bd9b677764 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:07.718376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b0d1c-67ad-4da5-b4fa-ac4ce8cf0d25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:07.718921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b0d1c-67ad-4da5-b4fa-ac4ce8cf0d25 service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:07.719204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b0d1c-67ad-4da5-b4fa-ac4ce8cf0d25 service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:07.719484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b0d1c-67ad-4da5-b4fa-ac4ce8cf0d25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:07.721210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b09b0d1c-67ad-4da5-b4fa-ac4ce8cf0d25 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:07.886218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b0d1c-67ad-4da5-b4fa-ac4ce8cf0d25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:07.887668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b0d1c-67ad-4da5-b4fa-ac4ce8cf0d25 service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:07.918019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 707/1393] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:08.725109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75899a10-f4dc-4d17-9d7e-48cec6075d63 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:08.725634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75899a10-f4dc-4d17-9d7e-48cec6075d63 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:08.725634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75899a10-f4dc-4d17-9d7e-48cec6075d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:08.812060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-75899a10-f4dc-4d17-9d7e-48cec6075d63 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:08.813309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-75899a10-f4dc-4d17-9d7e-48cec6075d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:08.916413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 687/1394] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:08.966216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208926c-ee1a-4d32-b11a-0747cec4c17b None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:08.967069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208926c-ee1a-4d32-b11a-0747cec4c17b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:08.967069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208926c-ee1a-4d32-b11a-0747cec4c17b None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:08.969036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 708/1395] 10.222.0.50 () {54 vars in 943 bytes} [Wed Sep 14 12:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:08.977445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5beb8-d14e-4a92-9f29-72cb76b1c36d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:08.977726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5beb8-d14e-4a92-9f29-72cb76b1c36d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:08.978002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5beb8-d14e-4a92-9f29-72cb76b1c36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:09.037131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:09.076729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-18d5beb8-d14e-4a92-9f29-72cb76b1c36d None None] MFA Rules not processed for user `59ec11c9fac7430c927f894959023e36`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:09.077950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-18d5beb8-d14e-4a92-9f29-72cb76b1c36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:09.244339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 688/1396] 10.222.0.50 () {58 vars in 1040 bytes} [Wed Sep 14 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:09.254485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208926c-ee1a-4d32-b11a-0747cec4c17b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:09.256136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e208926c-ee1a-4d32-b11a-0747cec4c17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:09.288176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:09.451351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208926c-ee1a-4d32-b11a-0747cec4c17b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:09.511179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c305f-6239-4f4f-a7ee-8b3a298a59c7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:09.511479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c305f-6239-4f4f-a7ee-8b3a298a59c7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:09.511734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c305f-6239-4f4f-a7ee-8b3a298a59c7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:09.513518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 689/1397] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:09.521198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d14ed-e4f7-4746-b0b3-6ad2b6be8599 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:09.521475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d14ed-e4f7-4746-b0b3-6ad2b6be8599 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:09.521752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d14ed-e4f7-4746-b0b3-6ad2b6be8599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:09.612190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:09.612936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:09.613216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:09.613542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:09.616172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:09.627101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:09.631335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-927d14ed-e4f7-4746-b0b3-6ad2b6be8599 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:09.633077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-927d14ed-e4f7-4746-b0b3-6ad2b6be8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:09.711069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:09.733248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:09.735059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:09.744847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 709/1398] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 12:54:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 12:54:09.774512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 690/1399] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:54:10.105825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:10.107032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:10.243060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd09a36-5da4-4dcf-a2e7-721c8c7c605e service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:10.327958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:10.414559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07607531-7916-4b63-9002-c5eeee3e82ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:10.416429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607531-7916-4b63-9002-c5eeee3e82ab service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:10.417060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607531-7916-4b63-9002-c5eeee3e82ab service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:10.417518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07607531-7916-4b63-9002-c5eeee3e82ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:10.420265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-07607531-7916-4b63-9002-c5eeee3e82ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:10.627077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607531-7916-4b63-9002-c5eeee3e82ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:10.632140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07607531-7916-4b63-9002-c5eeee3e82ab service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:10.657365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 710/1400] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:13.082804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28e9d-a309-4977-b4d9-5f35c6365ccc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:13.083411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28e9d-a309-4977-b4d9-5f35c6365ccc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:13.083411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da28e9d-a309-4977-b4d9-5f35c6365ccc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:13.084715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 691/1401] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:13.090673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d651-9641-42ee-894e-c896a8cdda33 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:13.091242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d651-9641-42ee-894e-c896a8cdda33 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:13.091242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d651-9641-42ee-894e-c896a8cdda33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:13.167519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4d82d651-9641-42ee-894e-c896a8cdda33 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:13.168814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4d82d651-9641-42ee-894e-c896a8cdda33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:13.188980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:13.287548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 711/1402] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:13.630078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da28e9d-a309-4977-b4d9-5f35c6365ccc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:13.632108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6da28e9d-a309-4977-b4d9-5f35c6365ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:13.872309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da28e9d-a309-4977-b4d9-5f35c6365ccc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:13.933453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:14.067594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648712-973b-464e-9b16-e8ea638c595c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:14.068667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648712-973b-464e-9b16-e8ea638c595c service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:14.069164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648712-973b-464e-9b16-e8ea638c595c service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:14.069562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648712-973b-464e-9b16-e8ea638c595c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:14.071663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-75648712-973b-464e-9b16-e8ea638c595c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:14.229851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648712-973b-464e-9b16-e8ea638c595c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:14.233264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648712-973b-464e-9b16-e8ea638c595c service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:14.264211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 692/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:16.785868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95236-ef26-48fb-9e6d-6ef554804824 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:16.786860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95236-ef26-48fb-9e6d-6ef554804824 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:16.787414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95236-ef26-48fb-9e6d-6ef554804824 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:16.788852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 712/1404] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:16.795023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82525a-8e86-429b-bbbe-3791b4ebbdc6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:16.795554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82525a-8e86-429b-bbbe-3791b4ebbdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:16.795554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82525a-8e86-429b-bbbe-3791b4ebbdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:16.851550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:16.876377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0d82525a-8e86-429b-bbbe-3791b4ebbdc6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:16.877867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0d82525a-8e86-429b-bbbe-3791b4ebbdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:17.003103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 693/1405] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:17.309946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec95236-ef26-48fb-9e6d-6ef554804824 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:17.311461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ec95236-ef26-48fb-9e6d-6ef554804824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:17.526054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:17.528930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec95236-ef26-48fb-9e6d-6ef554804824 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:17.674717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c60d44-8492-4fcb-af1a-f773a97226f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:17.675724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c60d44-8492-4fcb-af1a-f773a97226f5 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:17.676001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c60d44-8492-4fcb-af1a-f773a97226f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:17.676294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c60d44-8492-4fcb-af1a-f773a97226f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:17.678121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-60c60d44-8492-4fcb-af1a-f773a97226f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:17.788964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c60d44-8492-4fcb-af1a-f773a97226f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:17.791432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c60d44-8492-4fcb-af1a-f773a97226f5 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:17.811007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 713/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:20.132959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173585c2-863e-42b5-ace5-4a473101aaa6 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:20.134231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173585c2-863e-42b5-ace5-4a473101aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:20.135489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173585c2-863e-42b5-ace5-4a473101aaa6 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:20.137091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 694/1407] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:54:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:20.143416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ddb9f-d91b-41f4-8bc9-aafbc9b41a14 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:20.143987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ddb9f-d91b-41f4-8bc9-aafbc9b41a14 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:20.143987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ddb9f-d91b-41f4-8bc9-aafbc9b41a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:20.148518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:20.223295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4b2ddb9f-d91b-41f4-8bc9-aafbc9b41a14 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:20.225105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4b2ddb9f-d91b-41f4-8bc9-aafbc9b41a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:20.341780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 714/1408] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:20.651077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173585c2-863e-42b5-ace5-4a473101aaa6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:20.653358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-173585c2-863e-42b5-ace5-4a473101aaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:20.810085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:20.890648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173585c2-863e-42b5-ace5-4a473101aaa6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:21.056389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28df6c2-8117-47d6-b334-171d95f2ba3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:21.057687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df6c2-8117-47d6-b334-171d95f2ba3c service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:21.058039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df6c2-8117-47d6-b334-171d95f2ba3c service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:21.058373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28df6c2-8117-47d6-b334-171d95f2ba3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:21.060165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a28df6c2-8117-47d6-b334-171d95f2ba3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:21.157290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:21.175989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28df6c2-8117-47d6-b334-171d95f2ba3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:21.177680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28df6c2-8117-47d6-b334-171d95f2ba3c service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:21.199978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 695/1409] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:30.339940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=64 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:31.197376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=11 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:34.207224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8dc2d-eff3-4723-a01f-0080a47a5e99 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:34.207937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8dc2d-eff3-4723-a01f-0080a47a5e99 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:34.207937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8dc2d-eff3-4723-a01f-0080a47a5e99 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:34.209140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 715/1410] 10.222.0.50 () {54 vars in 918 bytes} [Wed Sep 14 12:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:34.215185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf5f5c-9dfc-4acc-88ae-7d6be626cb29 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:34.215701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf5f5c-9dfc-4acc-88ae-7d6be626cb29 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:34.215884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf5f5c-9dfc-4acc-88ae-7d6be626cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:34.296068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5fdf5f5c-9dfc-4acc-88ae-7d6be626cb29 None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:34.297319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5fdf5f5c-9dfc-4acc-88ae-7d6be626cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:34.434775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 696/1411] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Sep 14 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:54:34.452548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af9aa-b112-4f81-84cf-27742e4be92f None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:34.452832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af9aa-b112-4f81-84cf-27742e4be92f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:34.453111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223af9aa-b112-4f81-84cf-27742e4be92f None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:34.454453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 716/1412] 10.222.0.50 () {54 vars in 918 bytes} [Wed Sep 14 12:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:34.463569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1823a-54e5-4360-a7db-5d2243cd746e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:34.463777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1823a-54e5-4360-a7db-5d2243cd746e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:34.464909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1823a-54e5-4360-a7db-5d2243cd746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:34.566484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:34.569857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5bc1823a-54e5-4360-a7db-5d2243cd746e None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:34.572476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5bc1823a-54e5-4360-a7db-5d2243cd746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:34.750196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 697/1413] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Sep 14 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:37.418435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefbd3c-3263-4b2b-919b-f06f7c43ec57 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:37.419030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefbd3c-3263-4b2b-919b-f06f7c43ec57 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:37.419030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefbd3c-3263-4b2b-919b-f06f7c43ec57 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:37.420310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:37.425944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705d29-6430-4718-9a3d-d3ca3192bb88 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:37.426510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705d29-6430-4718-9a3d-d3ca3192bb88 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:37.426510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56705d29-6430-4718-9a3d-d3ca3192bb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:37.498504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-56705d29-6430-4718-9a3d-d3ca3192bb88 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:37.499729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-56705d29-6430-4718-9a3d-d3ca3192bb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:37.557425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:37.610757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:37.912082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefbd3c-3263-4b2b-919b-f06f7c43ec57 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:37.913738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8cefbd3c-3263-4b2b-919b-f06f7c43ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:38.063889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefbd3c-3263-4b2b-919b-f06f7c43ec57 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:38.139741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:38.182112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb9252-bd18-42a7-be92-53f3ca18fa75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:38.182842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9252-bd18-42a7-be92-53f3ca18fa75 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:38.183011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9252-bd18-42a7-be92-53f3ca18fa75 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:38.183284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb9252-bd18-42a7-be92-53f3ca18fa75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:38.184961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a7fb9252-bd18-42a7-be92-53f3ca18fa75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:38.282804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb9252-bd18-42a7-be92-53f3ca18fa75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:38.284449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb9252-bd18-42a7-be92-53f3ca18fa75 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:38.302993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 718/1416] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:39.495344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57c4b-4e2b-481c-bdf1-1e799f18d022 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:39.495953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57c4b-4e2b-481c-bdf1-1e799f18d022 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:39.495953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc57c4b-4e2b-481c-bdf1-1e799f18d022 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:39.497260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:39.503763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885559-cb12-49e4-82c7-2d5f335587a4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:39.504266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885559-cb12-49e4-82c7-2d5f335587a4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:39.504371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885559-cb12-49e4-82c7-2d5f335587a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:39.583339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ab885559-cb12-49e4-82c7-2d5f335587a4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:39.584579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ab885559-cb12-49e4-82c7-2d5f335587a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:39.619371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:39.699449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:39.852661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57c4b-4e2b-481c-bdf1-1e799f18d022 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:39.854431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3cc57c4b-4e2b-481c-bdf1-1e799f18d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:40.019823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc57c4b-4e2b-481c-bdf1-1e799f18d022 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:40.062974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:40.146103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eeffa-ae8e-4c47-b6df-49dce94725be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:40.146746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eeffa-ae8e-4c47-b6df-49dce94725be service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:40.147026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eeffa-ae8e-4c47-b6df-49dce94725be service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:40.147300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eeffa-ae8e-4c47-b6df-49dce94725be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:40.148975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-562eeffa-ae8e-4c47-b6df-49dce94725be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:40.247945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eeffa-ae8e-4c47-b6df-49dce94725be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:40.249593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eeffa-ae8e-4c47-b6df-49dce94725be service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:40.269457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 700/1419] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:41.454189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c4d5-4899-4b5b-a48e-c2d2c54dcff4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:41.454775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c4d5-4899-4b5b-a48e-c2d2c54dcff4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:41.454775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c4d5-4899-4b5b-a48e-c2d2c54dcff4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:41.456112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:41.463121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac2a7-da36-441e-a68c-0b976059a737 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:41.463627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac2a7-da36-441e-a68c-0b976059a737 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:41.463757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ac2a7-da36-441e-a68c-0b976059a737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:41.522170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:41.547139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-135ac2a7-da36-441e-a68c-0b976059a737 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:41.548398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-135ac2a7-da36-441e-a68c-0b976059a737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:41.685578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:41.853658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c4d5-4899-4b5b-a48e-c2d2c54dcff4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:41.855163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0ac7c4d5-4899-4b5b-a48e-c2d2c54dcff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:42.008723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c4d5-4899-4b5b-a48e-c2d2c54dcff4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:42.022713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:42.130665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69da88-b05d-4034-8ed2-fefe5f0d5883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:42.131139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69da88-b05d-4034-8ed2-fefe5f0d5883 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:42.131411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69da88-b05d-4034-8ed2-fefe5f0d5883 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:42.131677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69da88-b05d-4034-8ed2-fefe5f0d5883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:42.133297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2f69da88-b05d-4034-8ed2-fefe5f0d5883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:42.227137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69da88-b05d-4034-8ed2-fefe5f0d5883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:42.228887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69da88-b05d-4034-8ed2-fefe5f0d5883 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:42.252992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 721/1422] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:43.415426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e364-def8-4c3b-a6f0-abc0c4f739ff None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:43.416150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e364-def8-4c3b-a6f0-abc0c4f739ff None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:43.416984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e364-def8-4c3b-a6f0-abc0c4f739ff None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:43.421918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:43.432291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bed9b-7491-469f-bc64-89fde36ef85f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:43.433570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bed9b-7491-469f-bc64-89fde36ef85f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:43.433570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1bed9b-7491-469f-bc64-89fde36ef85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:43.455808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:43.536724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2f1bed9b-7491-469f-bc64-89fde36ef85f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:43.538010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2f1bed9b-7491-469f-bc64-89fde36ef85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:43.663272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:43.824832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e364-def8-4c3b-a6f0-abc0c4f739ff None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:43.826549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7fc9e364-def8-4c3b-a6f0-abc0c4f739ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:43.958043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:43.998119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e364-def8-4c3b-a6f0-abc0c4f739ff None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:44.118543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52165e8-92d9-4d80-a177-5f7d8c3cd020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:44.119191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52165e8-92d9-4d80-a177-5f7d8c3cd020 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:44.119481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52165e8-92d9-4d80-a177-5f7d8c3cd020 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:44.119766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52165e8-92d9-4d80-a177-5f7d8c3cd020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:44.121706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e52165e8-92d9-4d80-a177-5f7d8c3cd020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:44.214850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:44.229696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52165e8-92d9-4d80-a177-5f7d8c3cd020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:44.231324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52165e8-92d9-4d80-a177-5f7d8c3cd020 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:44.250696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 703/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:45.462312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34955-d160-4540-81a4-414254db7344 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:45.463114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34955-d160-4540-81a4-414254db7344 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:45.463114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34955-d160-4540-81a4-414254db7344 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:45.464315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:45.471046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863f22b-78c7-477c-b852-6b642eebbe93 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:45.471561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863f22b-78c7-477c-b852-6b642eebbe93 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:45.471666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863f22b-78c7-477c-b852-6b642eebbe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:45.553282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e863f22b-78c7-477c-b852-6b642eebbe93 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:45.554516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e863f22b-78c7-477c-b852-6b642eebbe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:45.668179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:45.831588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed34955-d160-4540-81a4-414254db7344 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:45.833663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5ed34955-d160-4540-81a4-414254db7344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:45.961473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:46.038189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed34955-d160-4540-81a4-414254db7344 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:46.175737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dba5da-ec14-4ac1-b1ca-7d19e8435334 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:46.176385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba5da-ec14-4ac1-b1ca-7d19e8435334 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:46.176661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba5da-ec14-4ac1-b1ca-7d19e8435334 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:46.176930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dba5da-ec14-4ac1-b1ca-7d19e8435334 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:46.178747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6dba5da-ec14-4ac1-b1ca-7d19e8435334 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:46.243387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:46.298050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dba5da-ec14-4ac1-b1ca-7d19e8435334 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:46.299696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dba5da-ec14-4ac1-b1ca-7d19e8435334 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:46.323844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 724/1428] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:54:47.579383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026286a3-239c-4721-bed6-7b0ebc11fecd None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:47.579977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026286a3-239c-4721-bed6-7b0ebc11fecd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:47.579977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026286a3-239c-4721-bed6-7b0ebc11fecd None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:47.581344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:54:47.589432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd90b-12c3-4585-939d-65f739a3af3f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:47.590007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd90b-12c3-4585-939d-65f739a3af3f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:47.590007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd90b-12c3-4585-939d-65f739a3af3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:47.702462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f40bd90b-12c3-4585-939d-65f739a3af3f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:47.703730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f40bd90b-12c3-4585-939d-65f739a3af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:47.866427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:54:48.021322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026286a3-239c-4721-bed6-7b0ebc11fecd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:48.023089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-026286a3-239c-4721-bed6-7b0ebc11fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:48.084982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:48.216861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026286a3-239c-4721-bed6-7b0ebc11fecd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:48.366887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b02c7-61a6-416d-ad55-30e06db67f9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:48.367511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b02c7-61a6-416d-ad55-30e06db67f9b service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:48.367790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b02c7-61a6-416d-ad55-30e06db67f9b service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:48.368114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b02c7-61a6-416d-ad55-30e06db67f9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:48.370356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-883b02c7-61a6-416d-ad55-30e06db67f9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:48.377827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:48.485213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b02c7-61a6-416d-ad55-30e06db67f9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:48.486857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b02c7-61a6-416d-ad55-30e06db67f9b service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:48.507323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 706/1431] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:49.687776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c72d-c25b-4d5b-a2e5-4a6ea5100390 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:49.688520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c72d-c25b-4d5b-a2e5-4a6ea5100390 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:49.688520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177c72d-c25b-4d5b-a2e5-4a6ea5100390 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:49.690557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:49.700454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc583a14-324f-4f99-9102-735c2e1b4a47 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:49.702664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc583a14-324f-4f99-9102-735c2e1b4a47 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:49.702664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc583a14-324f-4f99-9102-735c2e1b4a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:49.808875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dc583a14-324f-4f99-9102-735c2e1b4a47 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:49.810272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc583a14-324f-4f99-9102-735c2e1b4a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:49.901792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:49.942515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:50.139724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c72d-c25b-4d5b-a2e5-4a6ea5100390 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:50.142150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c177c72d-c25b-4d5b-a2e5-4a6ea5100390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:50.166925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:50.394187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177c72d-c25b-4d5b-a2e5-4a6ea5100390 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:50.547574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:50.585272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ad6ff-13fb-427b-8529-6f3eb80cd84d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:50.585928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ad6ff-13fb-427b-8529-6f3eb80cd84d service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:50.586216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ad6ff-13fb-427b-8529-6f3eb80cd84d service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:50.586497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ad6ff-13fb-427b-8529-6f3eb80cd84d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:50.589303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8e8ad6ff-13fb-427b-8529-6f3eb80cd84d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:50.865692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ad6ff-13fb-427b-8529-6f3eb80cd84d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:50.867260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ad6ff-13fb-427b-8529-6f3eb80cd84d service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:50.893925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 727/1434] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:52.288060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84ff1a-e795-441b-91d7-9bbd54629562 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:52.288060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84ff1a-e795-441b-91d7-9bbd54629562 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:52.288768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84ff1a-e795-441b-91d7-9bbd54629562 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:52.289794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:52.298832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519590-7f34-4dc2-b014-8d4ef13e0573 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:52.301019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519590-7f34-4dc2-b014-8d4ef13e0573 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:52.301019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85519590-7f34-4dc2-b014-8d4ef13e0573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:52.414465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-85519590-7f34-4dc2-b014-8d4ef13e0573 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:52.417992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-85519590-7f34-4dc2-b014-8d4ef13e0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:52.470844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:52.532989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:52.703843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84ff1a-e795-441b-91d7-9bbd54629562 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:52.705411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0c84ff1a-e795-441b-91d7-9bbd54629562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:52.904663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84ff1a-e795-441b-91d7-9bbd54629562 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:52.985588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:53.083337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac30c5-1fbf-478f-b454-4cedc315c97c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:53.083949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac30c5-1fbf-478f-b454-4cedc315c97c service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:53.084254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac30c5-1fbf-478f-b454-4cedc315c97c service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:53.084533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac30c5-1fbf-478f-b454-4cedc315c97c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:53.086193 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aeac30c5-1fbf-478f-b454-4cedc315c97c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:53.238246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac30c5-1fbf-478f-b454-4cedc315c97c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:53.239772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac30c5-1fbf-478f-b454-4cedc315c97c service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:53.263101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 709/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:54.385850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b39a-0f7e-4748-9845-9cba2ab25081 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:54.386413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b39a-0f7e-4748-9845-9cba2ab25081 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:54.386413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b39a-0f7e-4748-9845-9cba2ab25081 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:54.387870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:54.394922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f54c-a1fb-46e8-9360-7eddfc19036e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:54.395493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f54c-a1fb-46e8-9360-7eddfc19036e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:54.395493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363f54c-a1fb-46e8-9360-7eddfc19036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:54.488028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a363f54c-a1fb-46e8-9360-7eddfc19036e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:54.489294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a363f54c-a1fb-46e8-9360-7eddfc19036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:54.491600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:54.619244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:54:54.784905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b39a-0f7e-4748-9845-9cba2ab25081 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:54.787041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4444b39a-0f7e-4748-9845-9cba2ab25081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:54.977275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b39a-0f7e-4748-9845-9cba2ab25081 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:55.027260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:55.148720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f891313-2180-4464-9c57-0ee5bdce6422 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:55.149329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f891313-2180-4464-9c57-0ee5bdce6422 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:55.149609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f891313-2180-4464-9c57-0ee5bdce6422 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:55.149886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f891313-2180-4464-9c57-0ee5bdce6422 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:55.152410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8f891313-2180-4464-9c57-0ee5bdce6422 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:55.246461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f891313-2180-4464-9c57-0ee5bdce6422 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:55.248065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f891313-2180-4464-9c57-0ee5bdce6422 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:55.267215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 730/1440] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:54:57.417722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfac95-996d-41ed-94d8-b595d0e8f333 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:57.418422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfac95-996d-41ed-94d8-b595d0e8f333 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:57.418422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfac95-996d-41ed-94d8-b595d0e8f333 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:57.419865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:54:57.425839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f075-a16c-4c60-a14f-138d5f06e81a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:57.426359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f075-a16c-4c60-a14f-138d5f06e81a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:57.426359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26f075-a16c-4c60-a14f-138d5f06e81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:57.473285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:57.503371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7d26f075-a16c-4c60-a14f-138d5f06e81a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:54:57.504692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7d26f075-a16c-4c60-a14f-138d5f06e81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:57.614511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:54:57.914835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfac95-996d-41ed-94d8-b595d0e8f333 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:54:57.917924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-78bfac95-996d-41ed-94d8-b595d0e8f333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:58.047537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfac95-996d-41ed-94d8-b595d0e8f333 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:54:58.092035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:54:58.142287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814216e-caf2-4c07-bfdd-4bd76e296caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:54:58.143267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814216e-caf2-4c07-bfdd-4bd76e296caa service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:54:58.143739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814216e-caf2-4c07-bfdd-4bd76e296caa service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:54:58.144267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814216e-caf2-4c07-bfdd-4bd76e296caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:54:58.147254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d814216e-caf2-4c07-bfdd-4bd76e296caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:54:58.297997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814216e-caf2-4c07-bfdd-4bd76e296caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:54:58.299376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814216e-caf2-4c07-bfdd-4bd76e296caa service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:54:58.321217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 712/1443] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:00.843588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7c12-9b1b-4bca-9e91-498cca8e6bb1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:00.844353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7c12-9b1b-4bca-9e91-498cca8e6bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:00.844353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7c12-9b1b-4bca-9e91-498cca8e6bb1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:00.845997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:00.852726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea29f-6b2b-44c2-991c-10ff53aa8a97 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:00.854122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea29f-6b2b-44c2-991c-10ff53aa8a97 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:00.854122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ea29f-6b2b-44c2-991c-10ff53aa8a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:00.939503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-464ea29f-6b2b-44c2-991c-10ff53aa8a97 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:00.941110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-464ea29f-6b2b-44c2-991c-10ff53aa8a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:00.959457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:01.057812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:01.364322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d7c12-9b1b-4bca-9e91-498cca8e6bb1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:01.365864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fb6d7c12-9b1b-4bca-9e91-498cca8e6bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:01.491439 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d7c12-9b1b-4bca-9e91-498cca8e6bb1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:01.506019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:01.591180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f909f-9b02-44da-bcf4-b1e01dcb67c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:01.591799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f909f-9b02-44da-bcf4-b1e01dcb67c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:01.592193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f909f-9b02-44da-bcf4-b1e01dcb67c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:01.592391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f909f-9b02-44da-bcf4-b1e01dcb67c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:01.594061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a44f909f-9b02-44da-bcf4-b1e01dcb67c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:01.729920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f909f-9b02-44da-bcf4-b1e01dcb67c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:01.731394 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f909f-9b02-44da-bcf4-b1e01dcb67c4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:01.752104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 733/1446] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:04.456792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba924d-e2e6-4bd6-9faa-5be8756ba40b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:04.457683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba924d-e2e6-4bd6-9faa-5be8756ba40b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:04.457683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba924d-e2e6-4bd6-9faa-5be8756ba40b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:04.459262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:04.466100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bafc4-4552-4fb7-9950-8c57cba2907f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:04.466639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bafc4-4552-4fb7-9950-8c57cba2907f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:04.466639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bafc4-4552-4fb7-9950-8c57cba2907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:04.523428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:04.548715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-064bafc4-4552-4fb7-9950-8c57cba2907f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:04.549947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-064bafc4-4552-4fb7-9950-8c57cba2907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:04.670292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:04.966309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba924d-e2e6-4bd6-9faa-5be8756ba40b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:04.967880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3ba924d-e2e6-4bd6-9faa-5be8756ba40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:05.087115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba924d-e2e6-4bd6-9faa-5be8756ba40b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:05.136106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:05.180162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8555d5b-d9b0-4b0b-9ee8-12dd47417f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:05.180777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8555d5b-d9b0-4b0b-9ee8-12dd47417f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:05.181056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8555d5b-d9b0-4b0b-9ee8-12dd47417f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:05.181468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8555d5b-d9b0-4b0b-9ee8-12dd47417f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:05.183186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c8555d5b-d9b0-4b0b-9ee8-12dd47417f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:05.300303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8555d5b-d9b0-4b0b-9ee8-12dd47417f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:05.301737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8555d5b-d9b0-4b0b-9ee8-12dd47417f43 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:05.320101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 715/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:07.853966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa70b5e-4082-4e8e-aeb2-8156ed2d33ed None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:07.854511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa70b5e-4082-4e8e-aeb2-8156ed2d33ed None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:07.854511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa70b5e-4082-4e8e-aeb2-8156ed2d33ed None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:07.855745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:07.861656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b9a1f-3928-4725-977c-5c29c327c772 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:07.862178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b9a1f-3928-4725-977c-5c29c327c772 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:07.862277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b9a1f-3928-4725-977c-5c29c327c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:07.934877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-396b9a1f-3928-4725-977c-5c29c327c772 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:07.936137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-396b9a1f-3928-4725-977c-5c29c327c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:07.958787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:08.043262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:55:08.336973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa70b5e-4082-4e8e-aeb2-8156ed2d33ed None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:08.339085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-faa70b5e-4082-4e8e-aeb2-8156ed2d33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:08.457935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa70b5e-4082-4e8e-aeb2-8156ed2d33ed None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:08.480581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:08.536069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6b8c0-bf66-4e90-9619-4872a9e22097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:08.536676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b8c0-bf66-4e90-9619-4872a9e22097 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:08.536949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b8c0-bf66-4e90-9619-4872a9e22097 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:08.537219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6b8c0-bf66-4e90-9619-4872a9e22097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:08.538804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-61c6b8c0-bf66-4e90-9619-4872a9e22097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:08.674378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6b8c0-bf66-4e90-9619-4872a9e22097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:08.675821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6b8c0-bf66-4e90-9619-4872a9e22097 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:08.696787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 736/1452] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:11.130203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a04d-c0ce-452f-808a-ce3c6548d2bc None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:11.130752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a04d-c0ce-452f-808a-ce3c6548d2bc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:11.130752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a04d-c0ce-452f-808a-ce3c6548d2bc None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:11.132123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:11.138770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa0e92-d4aa-4bcb-99f6-c1e20812bb7f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:11.139259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa0e92-d4aa-4bcb-99f6-c1e20812bb7f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:11.139355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa0e92-d4aa-4bcb-99f6-c1e20812bb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:11.205909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:11.208931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e8fa0e92-d4aa-4bcb-99f6-c1e20812bb7f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:11.210822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e8fa0e92-d4aa-4bcb-99f6-c1e20812bb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:11.312741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:11.607612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7a04d-c0ce-452f-808a-ce3c6548d2bc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:11.609185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6bc7a04d-c0ce-452f-808a-ce3c6548d2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:11.721471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7a04d-c0ce-452f-808a-ce3c6548d2bc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:11.777238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:11.804127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7511d-aa0d-4a70-b8ef-7f14cf333c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:11.804741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7511d-aa0d-4a70-b8ef-7f14cf333c59 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:11.805025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7511d-aa0d-4a70-b8ef-7f14cf333c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:11.805300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7511d-aa0d-4a70-b8ef-7f14cf333c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:11.807091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9ff7511d-aa0d-4a70-b8ef-7f14cf333c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:11.929705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7511d-aa0d-4a70-b8ef-7f14cf333c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:11.931197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7511d-aa0d-4a70-b8ef-7f14cf333c59 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:11.951642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 718/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:14.368042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2777-ec81-48b3-b2d6-6396ae0b14e1 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:14.368042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2777-ec81-48b3-b2d6-6396ae0b14e1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:14.368042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d2777-ec81-48b3-b2d6-6396ae0b14e1 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:14.369926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:14.375824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623437-3c22-4e6a-b08e-5c83fb6d0a5b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:14.376447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623437-3c22-4e6a-b08e-5c83fb6d0a5b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:14.376447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6623437-3c22-4e6a-b08e-5c83fb6d0a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:14.469235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d6623437-3c22-4e6a-b08e-5c83fb6d0a5b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:14.471187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d6623437-3c22-4e6a-b08e-5c83fb6d0a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:14.507577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:14.615820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:14.958916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2777-ec81-48b3-b2d6-6396ae0b14e1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:14.960505 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e43d2777-ec81-48b3-b2d6-6396ae0b14e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:15.089687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d2777-ec81-48b3-b2d6-6396ae0b14e1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:15.125736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:15.182972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa55e82-96de-49c9-9dbe-508c36438022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:15.183576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55e82-96de-49c9-9dbe-508c36438022 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:15.184049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55e82-96de-49c9-9dbe-508c36438022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:15.184317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa55e82-96de-49c9-9dbe-508c36438022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:15.186119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-faa55e82-96de-49c9-9dbe-508c36438022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:15.320079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa55e82-96de-49c9-9dbe-508c36438022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:15.321415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa55e82-96de-49c9-9dbe-508c36438022 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:15.348786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 739/1458] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:17.700796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae640861-cfd1-4168-9e56-0d9f6c4fd149 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:17.701609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae640861-cfd1-4168-9e56-0d9f6c4fd149 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:17.701609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae640861-cfd1-4168-9e56-0d9f6c4fd149 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:17.702629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:17.708515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91016-bed2-4a10-8573-8099ddeebf84 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:17.709028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91016-bed2-4a10-8573-8099ddeebf84 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:17.709194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91016-bed2-4a10-8573-8099ddeebf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:17.785211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bea91016-bed2-4a10-8573-8099ddeebf84 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:17.786446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bea91016-bed2-4a10-8573-8099ddeebf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:17.796700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:17.894454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:18.199322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae640861-cfd1-4168-9e56-0d9f6c4fd149 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:18.200893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ae640861-cfd1-4168-9e56-0d9f6c4fd149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:18.314053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae640861-cfd1-4168-9e56-0d9f6c4fd149 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:18.373317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:18.393166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36cb30-54a4-407c-a9d9-00c57fa1a03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:18.393788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36cb30-54a4-407c-a9d9-00c57fa1a03c service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:18.394063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36cb30-54a4-407c-a9d9-00c57fa1a03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:18.394365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36cb30-54a4-407c-a9d9-00c57fa1a03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:18.396051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0c36cb30-54a4-407c-a9d9-00c57fa1a03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:18.536219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36cb30-54a4-407c-a9d9-00c57fa1a03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:18.537648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36cb30-54a4-407c-a9d9-00c57fa1a03c service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:18.559979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 721/1461] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:20.907989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9617f1-9feb-4ccc-86fb-b422019946c7 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:20.908605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9617f1-9feb-4ccc-86fb-b422019946c7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:20.908605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9617f1-9feb-4ccc-86fb-b422019946c7 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:20.909928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:20.917965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b7a1-e412-4bb6-922f-67b5e705ddcc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:20.918546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b7a1-e412-4bb6-922f-67b5e705ddcc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:20.918546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b7a1-e412-4bb6-922f-67b5e705ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:20.999870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-86b9b7a1-e412-4bb6-922f-67b5e705ddcc None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:21.001160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-86b9b7a1-e412-4bb6-922f-67b5e705ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:21.045637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:21.109131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:21.396616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9617f1-9feb-4ccc-86fb-b422019946c7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:21.398179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3d9617f1-9feb-4ccc-86fb-b422019946c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:21.520244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9617f1-9feb-4ccc-86fb-b422019946c7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:21.564307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:21.606569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac872a3-0011-4f2f-ab03-aa3c96ca06d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:21.607181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac872a3-0011-4f2f-ab03-aa3c96ca06d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:21.607458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac872a3-0011-4f2f-ab03-aa3c96ca06d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:21.607726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac872a3-0011-4f2f-ab03-aa3c96ca06d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:21.609455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ac872a3-0011-4f2f-ab03-aa3c96ca06d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:21.750707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac872a3-0011-4f2f-ab03-aa3c96ca06d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:21.752107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac872a3-0011-4f2f-ab03-aa3c96ca06d7 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:21.774268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 742/1464] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:24.078116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041ac7-9162-43e4-b18c-c077f7643ca7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:24.078706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041ac7-9162-43e4-b18c-c077f7643ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:24.078706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58041ac7-9162-43e4-b18c-c077f7643ca7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:24.080035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:55:24.085942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2190cd-94d2-4c3f-8f99-8e8f1bed30d7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:24.086739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2190cd-94d2-4c3f-8f99-8e8f1bed30d7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:24.086739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2190cd-94d2-4c3f-8f99-8e8f1bed30d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:24.202252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ec2190cd-94d2-4c3f-8f99-8e8f1bed30d7 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:24.204398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ec2190cd-94d2-4c3f-8f99-8e8f1bed30d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:24.232065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:24.350140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:55:24.645220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58041ac7-9162-43e4-b18c-c077f7643ca7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:24.646785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-58041ac7-9162-43e4-b18c-c077f7643ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:24.778906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58041ac7-9162-43e4-b18c-c077f7643ca7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:24.866049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:24.875311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325a0dc-afd3-498a-bf73-834137fb2437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:24.875832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a0dc-afd3-498a-bf73-834137fb2437 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:24.876157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a0dc-afd3-498a-bf73-834137fb2437 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:24.876432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325a0dc-afd3-498a-bf73-834137fb2437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:24.878056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3325a0dc-afd3-498a-bf73-834137fb2437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:24.999884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325a0dc-afd3-498a-bf73-834137fb2437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:25.001361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325a0dc-afd3-498a-bf73-834137fb2437 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:25.021540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 724/1467] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:27.269963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980703f8-6e21-4800-bf2c-8655a8664960 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:27.270508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980703f8-6e21-4800-bf2c-8655a8664960 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:27.270508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980703f8-6e21-4800-bf2c-8655a8664960 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:27.271829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:27.279542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e7227-c8b6-4b33-84d0-c8b7adc7bded None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:27.280122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e7227-c8b6-4b33-84d0-c8b7adc7bded None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:27.280122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e7227-c8b6-4b33-84d0-c8b7adc7bded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:27.357339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7a5e7227-c8b6-4b33-84d0-c8b7adc7bded None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:27.358556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7a5e7227-c8b6-4b33-84d0-c8b7adc7bded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:27.420118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:27.472933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:55:27.761220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980703f8-6e21-4800-bf2c-8655a8664960 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:27.762759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-980703f8-6e21-4800-bf2c-8655a8664960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:27.879634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980703f8-6e21-4800-bf2c-8655a8664960 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:27.930850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:27.959377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130d20b-4eb6-4b5a-b244-05b30584c004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:27.959900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d20b-4eb6-4b5a-b244-05b30584c004 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:27.960207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d20b-4eb6-4b5a-b244-05b30584c004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:27.960480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130d20b-4eb6-4b5a-b244-05b30584c004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:27.962085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7130d20b-4eb6-4b5a-b244-05b30584c004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:28.096370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d20b-4eb6-4b5a-b244-05b30584c004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:28.097801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130d20b-4eb6-4b5a-b244-05b30584c004 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:28.119343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 745/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:37.471297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=22 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:38.114832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=66 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:48.988884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62029ea8-38fc-4937-aeb5-46ccee2532fa None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:48.989508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62029ea8-38fc-4937-aeb5-46ccee2532fa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:48.989508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62029ea8-38fc-4937-aeb5-46ccee2532fa None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:48.990855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 726/1471] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:48.998874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b45ff-b263-440e-83c5-43164a6065de None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:48.999619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b45ff-b263-440e-83c5-43164a6065de None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:49.000065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b45ff-b263-440e-83c5-43164a6065de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:49.075778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-582b45ff-b263-440e-83c5-43164a6065de None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:49.077046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-582b45ff-b263-440e-83c5-43164a6065de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:49.185634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 746/1472] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:49.491776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219479-e7dd-4bf6-a130-9abfb2fc483c None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:49.492118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219479-e7dd-4bf6-a130-9abfb2fc483c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:49.492402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75219479-e7dd-4bf6-a130-9abfb2fc483c None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:49.493940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 727/1473] 10.222.0.50 () {54 vars in 966 bytes} [Wed Sep 14 12:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:55:49.499247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73986c2-b7b0-4fb2-8be2-c3a484cb998d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:49.499531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73986c2-b7b0-4fb2-8be2-c3a484cb998d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:49.499804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73986c2-b7b0-4fb2-8be2-c3a484cb998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:49.580799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d73986c2-b7b0-4fb2-8be2-c3a484cb998d None None] MFA Rules not processed for user `59b299d3239e4f53912477d94975d9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:49.582036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d73986c2-b7b0-4fb2-8be2-c3a484cb998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:49.605346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:49.672683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 747/1474] 10.222.0.50 () {58 vars in 1063 bytes} [Wed Sep 14 12:55:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:49.680245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75219479-e7dd-4bf6-a130-9abfb2fc483c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:49.682440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-75219479-e7dd-4bf6-a130-9abfb2fc483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:49.796834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75219479-e7dd-4bf6-a130-9abfb2fc483c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:49.874529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd5dc95-7ce1-4c8d-b182-8bdc45c6d253 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:49.875415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5dc95-7ce1-4c8d-b182-8bdc45c6d253 service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:49.875415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5dc95-7ce1-4c8d-b182-8bdc45c6d253 service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:49.876078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd5dc95-7ce1-4c8d-b182-8bdc45c6d253 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:49.877362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5bd5dc95-7ce1-4c8d-b182-8bdc45c6d253 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:49.940312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:49.997981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5dc95-7ce1-4c8d-b182-8bdc45c6d253 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:49.999436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd5dc95-7ce1-4c8d-b182-8bdc45c6d253 service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:50.018783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 728/1475] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:52.410296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9f36-5a22-407a-a3d7-d98509b5347d None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:52.411066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9f36-5a22-407a-a3d7-d98509b5347d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:52.411066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa9f36-5a22-407a-a3d7-d98509b5347d None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:52.412439 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 748/1476] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:52.419413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f392-0032-4e8a-ab11-58a07559c079 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:52.420067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f392-0032-4e8a-ab11-58a07559c079 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:52.420067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213f392-0032-4e8a-ab11-58a07559c079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:52.494344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0213f392-0032-4e8a-ab11-58a07559c079 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:52.495821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0213f392-0032-4e8a-ab11-58a07559c079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:52.613524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 729/1477] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:52.901160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9f36-5a22-407a-a3d7-d98509b5347d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:52.902956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-affa9f36-5a22-407a-a3d7-d98509b5347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:53.037201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa9f36-5a22-407a-a3d7-d98509b5347d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:53.093001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:53.144129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc9045-b333-4482-b730-9045a0b1e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:53.144724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9045-b333-4482-b730-9045a0b1e371 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:53.144997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9045-b333-4482-b730-9045a0b1e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:53.145264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc9045-b333-4482-b730-9045a0b1e371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:53.145904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc9045-b333-4482-b730-9045a0b1e371 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:53.147666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-dfcc9045-b333-4482-b730-9045a0b1e371 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:55:53.147666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 12:55:53.147666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 12:55:53.148826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc9045-b333-4482-b730-9045a0b1e371 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:53.172336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 749/1478] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Sep 14 12:55:52 2022] GET /identity/v3/projects => generated 2553 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:55:55.430127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8a883-0bc0-4ae4-b935-9086122c8d59 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:55.431219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8a883-0bc0-4ae4-b935-9086122c8d59 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:55.431219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8a883-0bc0-4ae4-b935-9086122c8d59 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:55.432611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 730/1479] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:55.438761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec724db-e2f3-4d99-9ae3-b5d3f9e1267e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:55.439266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec724db-e2f3-4d99-9ae3-b5d3f9e1267e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:55.439387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec724db-e2f3-4d99-9ae3-b5d3f9e1267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:55.513241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4ec724db-e2f3-4d99-9ae3-b5d3f9e1267e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:55.514486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ec724db-e2f3-4d99-9ae3-b5d3f9e1267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:55.618023 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 750/1480] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:55:55.923505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8a883-0bc0-4ae4-b935-9086122c8d59 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:55.925309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0e8a883-0bc0-4ae4-b935-9086122c8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:55.935900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:56.085972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8a883-0bc0-4ae4-b935-9086122c8d59 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:56.170776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:56.206647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0e41-7821-4b95-9707-294fe1b1f696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:56.207257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0e41-7821-4b95-9707-294fe1b1f696 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:56.207534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0e41-7821-4b95-9707-294fe1b1f696 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:56.207803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0e41-7821-4b95-9707-294fe1b1f696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:56.209452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-60bd0e41-7821-4b95-9707-294fe1b1f696 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:56.314116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0e41-7821-4b95-9707-294fe1b1f696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:56.316128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0e41-7821-4b95-9707-294fe1b1f696 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:56.334566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 731/1481] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:55:58.839228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466a06-ee9d-4805-8f04-e0d1a94f6683 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:58.839970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466a06-ee9d-4805-8f04-e0d1a94f6683 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:58.839970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06466a06-ee9d-4805-8f04-e0d1a94f6683 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:58.841146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 751/1482] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:55:58.847373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0535b8-d5fe-4b17-8178-0ef196c04ca0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:58.847880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0535b8-d5fe-4b17-8178-0ef196c04ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:58.848032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0535b8-d5fe-4b17-8178-0ef196c04ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:59.049799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6e0535b8-d5fe-4b17-8178-0ef196c04ca0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:55:59.051055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6e0535b8-d5fe-4b17-8178-0ef196c04ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:59.101308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:59.158847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 732/1483] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:55:59.463991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466a06-ee9d-4805-8f04-e0d1a94f6683 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:55:59.465649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-06466a06-ee9d-4805-8f04-e0d1a94f6683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:59.491904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:59.585414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06466a06-ee9d-4805-8f04-e0d1a94f6683 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:55:59.675798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ffcbc-06be-448c-afd0-4b6a12012598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:55:59.676443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ffcbc-06be-448c-afd0-4b6a12012598 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:55:59.676721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ffcbc-06be-448c-afd0-4b6a12012598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:55:59.676997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ffcbc-06be-448c-afd0-4b6a12012598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:55:59.678658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a21ffcbc-06be-448c-afd0-4b6a12012598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:55:59.765579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:55:59.814475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ffcbc-06be-448c-afd0-4b6a12012598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:55:59.817144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ffcbc-06be-448c-afd0-4b6a12012598 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:55:59.838765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 752/1484] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:56:02.178614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eee201-bdc2-406c-8765-db13a59af790 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:02.179428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eee201-bdc2-406c-8765-db13a59af790 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:02.179428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eee201-bdc2-406c-8765-db13a59af790 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:02.181101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 733/1485] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:56:02.187092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffefe5-bc19-4265-b9e6-f9188bcc106d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:02.187601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffefe5-bc19-4265-b9e6-f9188bcc106d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:02.187601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffefe5-bc19-4265-b9e6-f9188bcc106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:02.259327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d0ffefe5-bc19-4265-b9e6-f9188bcc106d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:56:02.260758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d0ffefe5-bc19-4265-b9e6-f9188bcc106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:02.366103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 753/1486] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:56:02.665902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eee201-bdc2-406c-8765-db13a59af790 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:56:02.667816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d6eee201-bdc2-406c-8765-db13a59af790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:02.789523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eee201-bdc2-406c-8765-db13a59af790 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:56:02.874293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:56:02.878406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3792ec4-a067-48dc-9f05-b701970dc63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:56:02.879029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3792ec4-a067-48dc-9f05-b701970dc63f service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:02.879314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3792ec4-a067-48dc-9f05-b701970dc63f service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:02.879588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3792ec4-a067-48dc-9f05-b701970dc63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:02.881272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f3792ec4-a067-48dc-9f05-b701970dc63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:03.004265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3792ec4-a067-48dc-9f05-b701970dc63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:56:03.005701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3792ec4-a067-48dc-9f05-b701970dc63f service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:56:03.025775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 734/1487] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:56:05.417449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694765-8b21-4d56-b420-9490c2cc8cb2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:05.418069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694765-8b21-4d56-b420-9490c2cc8cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:05.418069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47694765-8b21-4d56-b420-9490c2cc8cb2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:05.419463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 754/1488] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:56:05.426132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29433-678e-4ab4-89f2-247f2b54c6bd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:05.426668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29433-678e-4ab4-89f2-247f2b54c6bd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:05.426766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a29433-678e-4ab4-89f2-247f2b54c6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:05.498662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d3a29433-678e-4ab4-89f2-247f2b54c6bd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:56:05.499878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3a29433-678e-4ab4-89f2-247f2b54c6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:05.560436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:56:05.613683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 735/1489] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:56:05.920666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694765-8b21-4d56-b420-9490c2cc8cb2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:56:05.923281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-47694765-8b21-4d56-b420-9490c2cc8cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:05.969078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:56:06.052270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47694765-8b21-4d56-b420-9490c2cc8cb2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:56:06.145455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63690d57-be21-416f-862b-bdb40bfb1ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:56:06.146152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690d57-be21-416f-862b-bdb40bfb1ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:06.146425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690d57-be21-416f-862b-bdb40bfb1ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:06.146695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690d57-be21-416f-862b-bdb40bfb1ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:06.148962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63690d57-be21-416f-862b-bdb40bfb1ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:06.246528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:56:06.280167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690d57-be21-416f-862b-bdb40bfb1ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:56:06.281957 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63690d57-be21-416f-862b-bdb40bfb1ef1 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:56:06.302798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 755/1490] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:56:08.886420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c5bf1-94c8-4bc6-84d6-0748e435dbda None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:08.886997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c5bf1-94c8-4bc6-84d6-0748e435dbda None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:08.886997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c5bf1-94c8-4bc6-84d6-0748e435dbda None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:08.888377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 736/1491] 10.222.0.50 () {54 vars in 927 bytes} [Wed Sep 14 12:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:56:08.894222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74abb12-fc3d-4a72-bb04-715ae0e74325 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:08.894751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74abb12-fc3d-4a72-bb04-715ae0e74325 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:08.894751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74abb12-fc3d-4a72-bb04-715ae0e74325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:08.970256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d74abb12-fc3d-4a72-bb04-715ae0e74325 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:56:08.971494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d74abb12-fc3d-4a72-bb04-715ae0e74325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:09.083773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 756/1492] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Sep 14 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:56:09.381748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c5bf1-94c8-4bc6-84d6-0748e435dbda None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:56:09.383287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e16c5bf1-94c8-4bc6-84d6-0748e435dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:09.501972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c5bf1-94c8-4bc6-84d6-0748e435dbda None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:56:09.584529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99ef4b-fccf-44f1-ad8a-9ddd89df78ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:56:09.585136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ef4b-fccf-44f1-ad8a-9ddd89df78ba service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:56:09.585414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ef4b-fccf-44f1-ad8a-9ddd89df78ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:56:09.585689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99ef4b-fccf-44f1-ad8a-9ddd89df78ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:56:09.588071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7e99ef4b-fccf-44f1-ad8a-9ddd89df78ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:56:09.599229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:56:09.710645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99ef4b-fccf-44f1-ad8a-9ddd89df78ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:56:09.712341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99ef4b-fccf-44f1-ad8a-9ddd89df78ba service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:56:09.731897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 737/1493] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:56:19.082290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=82 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:56:19.729522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=50 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:27.073645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:27.074633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:27.074633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:27.190792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:57:27.192049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:27.319189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 757/1494] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:57:27.328628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007c8b-a65b-474f-8225-7b2fea930d5c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:27.329193 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007c8b-a65b-474f-8225-7b2fea930d5c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:27.329193 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78007c8b-a65b-474f-8225-7b2fea930d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:27.434255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-78007c8b-a65b-474f-8225-7b2fea930d5c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:57:27.435686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-78007c8b-a65b-474f-8225-7b2fea930d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:27.578599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 738/1495] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 12:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:57:27.587826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:27.590206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:27.607314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf283f24-4c3f-466c-ae75-dd4846a2d421 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:27.710127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:27.763245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:27.764089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:27.764478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:27.764880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:27.765643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 12:57:27.766089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:27.767345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:27.767345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 12:57:27.767345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 12:57:27.768633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:27.787363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 758/1496] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 12:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:57:27.796903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007c8b-a65b-474f-8225-7b2fea930d5c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:27.809918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78007c8b-a65b-474f-8225-7b2fea930d5c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:27.893636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:27.946107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:27.946727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:27.947003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:27.947276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:27.947924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:27.949759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:27.949759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: warnings.warn(msg) Sep 14 12:57:27.949759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: Sep 14 12:57:27.951194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:28.019569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 739/1497] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 12:57:27 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:57:28.024754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:28.027233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:28.076969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcb755-d73b-4568-a17a-c6cbb6044e8c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:28.214129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:28.215000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:28.215479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:28.215952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:28.217102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:28.218629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:28.218629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 12:57:28.218629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 12:57:28.220755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:28.281668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 759/1498] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 12:57:28 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 12:57:28.286112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:28.287711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:28.363740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18000af1-78ff-4cd3-b21e-5673a8e51cf8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:28.483121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:28.502231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:28.503046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:28.503312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:28.503606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:28.504309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:28.505331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:28.505331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: warnings.warn(msg) Sep 14 12:57:28.505331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: Sep 14 12:57:28.506221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:28.520372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 740/1499] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 12:57:28.525090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:28.526725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:28.541850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a262b-5402-4fb0-bc30-771a2cb34f5a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:28.576125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:28.673595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6e9a5-2017-4a2d-ae73-e7fee473c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:28.674255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6e9a5-2017-4a2d-ae73-e7fee473c411 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:28.674572 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6e9a5-2017-4a2d-ae73-e7fee473c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:28.674883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6e9a5-2017-4a2d-ae73-e7fee473c411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:28.675613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6e9a5-2017-4a2d-ae73-e7fee473c411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:28.676830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-6ec6e9a5-2017-4a2d-ae73-e7fee473c411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:28.676830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 12:57:28.676830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 12:57:28.678521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6e9a5-2017-4a2d-ae73-e7fee473c411 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:28.694477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 760/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 12:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 12:57:28.698874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:28.700473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:28.742850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800e7ce-07a4-4e42-9a1c-7afb84d773de admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:28.869998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9af11-1441-4a0c-ac90-c03d88df0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:28.870668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9af11-1441-4a0c-ac90-c03d88df0762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:28.870950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9af11-1441-4a0c-ac90-c03d88df0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:28.871217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9af11-1441-4a0c-ac90-c03d88df0762 admin admin] PATH_INFO: `/v3/projects/3039e9f5327a4ed895065125aa462bf5/users/98083f0bedca4f37864826b95c65c49c/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:28.901915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9af11-1441-4a0c-ac90-c03d88df0762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3039e9f5327a4ed895065125aa462bf5, user_id=98083f0bedca4f37864826b95c65c49c, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:28.903327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-c2d9af11-1441-4a0c-ac90-c03d88df0762 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:28.903327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: warnings.warn(msg) Sep 14 12:57:28.903327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: Sep 14 12:57:28.905652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9af11-1441-4a0c-ac90-c03d88df0762 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:28.950418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 741/1501] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 12:57:28 2022] PUT /identity/v3/projects/3039e9f5327a4ed895065125aa462bf5/users/98083f0bedca4f37864826b95c65c49c/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:57:28.968517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849135ec-afc3-4f13-8392-ddb42217dda1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:28.968808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849135ec-afc3-4f13-8392-ddb42217dda1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:28.969091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849135ec-afc3-4f13-8392-ddb42217dda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:29.042259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-849135ec-afc3-4f13-8392-ddb42217dda1 None None] MFA Rules not processed for user `98083f0bedca4f37864826b95c65c49c`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:57:29.044176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-849135ec-afc3-4f13-8392-ddb42217dda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:29.140909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 761/1502] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 12:57:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:57:29.155813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4817ee-a77c-4ea8-886f-bb690e69459a None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:29.156213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4817ee-a77c-4ea8-886f-bb690e69459a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:29.156408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4817ee-a77c-4ea8-886f-bb690e69459a None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:29.157752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 742/1503] 10.222.0.50 () {54 vars in 964 bytes} [Wed Sep 14 12:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:57:29.163313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874926e-b0ea-4f8a-a005-41ed3145d738 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:29.163641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874926e-b0ea-4f8a-a005-41ed3145d738 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:29.163987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874926e-b0ea-4f8a-a005-41ed3145d738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:29.200537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:29.260538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6874926e-b0ea-4f8a-a005-41ed3145d738 None None] MFA Rules not processed for user `05fad60cd02c4c2295beb15783aecfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:57:29.261934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6874926e-b0ea-4f8a-a005-41ed3145d738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:29.369937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 762/1504] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Sep 14 12:57:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:57:29.383924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4817ee-a77c-4ea8-886f-bb690e69459a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:29.386168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3d4817ee-a77c-4ea8-886f-bb690e69459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:29.459258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:29.529734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4817ee-a77c-4ea8-886f-bb690e69459a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:29.641455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:29.642069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:29.642350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:29.642612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:29.644307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:29.769172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:29.770621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:29.775081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:29.797805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 743/1505] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:57:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:57:29.859793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf4ce-2192-427b-8bee-7f7696cb1fe4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:29.860890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf4ce-2192-427b-8bee-7f7696cb1fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:29.860890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcf4ce-2192-427b-8bee-7f7696cb1fe4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:29.861932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 763/1506] 10.222.0.50 () {52 vars in 830 bytes} [Wed Sep 14 12:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:57:29.867086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:29.870161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:29.988926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba38152-60a3-4805-ba42-fdcbf6517e50 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:30.124447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:30.125319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:30.125781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:30.126089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] PATH_INFO: `/v3/users/98083f0bedca4f37864826b95c65c49c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:30.141840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98083f0bedca4f37864826b95c65c49c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:30.142933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:30.142933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: warnings.warn(msg) Sep 14 12:57:30.142933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: Sep 14 12:57:30.144185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:30.157486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:30.227794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98083f0bedca4f37864826b95c65c49c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:30.228627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98083f0bedca4f37864826b95c65c49c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:30.229585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98083f0bedca4f37864826b95c65c49c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:30.253162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98083f0bedca4f37864826b95c65c49c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:30.293669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98083f0bedca4f37864826b95c65c49c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:30.316625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 744/1507] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 12:57:29 2022] DELETE /identity/v3/users/98083f0bedca4f37864826b95c65c49c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 12:57:30.323160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:30.324105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:30.324105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:30.409014 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:57:30.410351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:30.503485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:30.520241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 764/1508] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 12:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:57:30.532626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:30.534267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:30.689115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2a5b2-d807-4564-aad7-3d6fdf5b2ff4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:30.759700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:30.789154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cb663-723a-444f-b890-c0723b71a0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:30.790060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb663-723a-444f-b890-c0723b71a0fb service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:30.790380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb663-723a-444f-b890-c0723b71a0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:30.790799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cb663-723a-444f-b890-c0723b71a0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:30.794465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-478cb663-723a-444f-b890-c0723b71a0fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:30.926388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cb663-723a-444f-b890-c0723b71a0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:30.927833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cb663-723a-444f-b890-c0723b71a0fb service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:30.949011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 745/1509] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:57:31.374937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:57:31.376761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:57:31.392846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0d3e5-4042-4804-9dee-6d7bd9a34f5c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:57:31.571532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:57:31.572678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:57:31.573078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:57:31.573359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] PATH_INFO: `/v3/projects/3039e9f5327a4ed895065125aa462bf5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:57:31.587423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3039e9f5327a4ed895065125aa462bf5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:57:31.589117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 12:57:31.589117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 12:57:31.589117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 12:57:31.591250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:57:31.705266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3039e9f5327a4ed895065125aa462bf5', 'request_id': 'req-f630923b-92c2-4618-bd4b-3503cfd52483'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:31.725275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3039e9f5327a4ed895065125aa462bf5', 'request_id': 'req-f630923b-92c2-4618-bd4b-3503cfd52483'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:31.740788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3039e9f5327a4ed895065125aa462bf5', 'request_id': 'req-f630923b-92c2-4618-bd4b-3503cfd52483'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:31.772221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] The token cache is being invalidate because project 3039e9f5327a4ed895065125aa462bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 12:57:31.773035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:31.773398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f630923b-92c2-4618-bd4b-3503cfd52483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 12:57:31.778113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 765/1510] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 12:57:31 2022] DELETE /identity/v3/projects/3039e9f5327a4ed895065125aa462bf5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 12:57:40.945888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=62 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:57:41.769532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:59:10.821030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cb1d4-a4c6-429d-8f3a-77bc03d898cf None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:10.821651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cb1d4-a4c6-429d-8f3a-77bc03d898cf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:10.822030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140cb1d4-a4c6-429d-8f3a-77bc03d898cf None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:10.828170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:59:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:10.830359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e889b-8c87-4744-9dac-790480a11483 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:10.830869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e889b-8c87-4744-9dac-790480a11483 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:10.830977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e889b-8c87-4744-9dac-790480a11483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:10.937228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-fa1e889b-8c87-4744-9dac-790480a11483 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:10.939351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fa1e889b-8c87-4744-9dac-790480a11483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:11.089895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:11.256496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cb1d4-a4c6-429d-8f3a-77bc03d898cf None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:11.259263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-140cb1d4-a4c6-429d-8f3a-77bc03d898cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:11.456226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140cb1d4-a4c6-429d-8f3a-77bc03d898cf None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:11.464963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bf058-68fb-4cd2-a5b8-a0ab045553fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:11.465629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf058-68fb-4cd2-a5b8-a0ab045553fb service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:11.465909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf058-68fb-4cd2-a5b8-a0ab045553fb service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:11.466177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bf058-68fb-4cd2-a5b8-a0ab045553fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:11.475954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bf058-68fb-4cd2-a5b8-a0ab045553fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:11.477627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bf058-68fb-4cd2-a5b8-a0ab045553fb service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:11.490150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 747/1513] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:59:11.960588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97482333-bdc8-47da-83ca-e92b9bb6b81e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:11.961459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97482333-bdc8-47da-83ca-e92b9bb6b81e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:11.961459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97482333-bdc8-47da-83ca-e92b9bb6b81e None None] PATH_INFO: `/v3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:11.962810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 767/1514] 10.222.0.87 () {54 vars in 925 bytes} [Wed Sep 14 12:59:11 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 12:59:11.970131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a8e9-f107-43d6-a98f-e36fb51c6f0e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:11.970996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a8e9-f107-43d6-a98f-e36fb51c6f0e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:11.970996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4a8e9-f107-43d6-a98f-e36fb51c6f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:12.053191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bbf4a8e9-f107-43d6-a98f-e36fb51c6f0e None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:12.054437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bbf4a8e9-f107-43d6-a98f-e36fb51c6f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:12.156317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:59:12.162876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 748/1515] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Sep 14 12:59:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:59:12.727934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8b32-2ae8-4db1-9cfa-d01dac4219fd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:12.728233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8b32-2ae8-4db1-9cfa-d01dac4219fd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:12.728506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec8b32-2ae8-4db1-9cfa-d01dac4219fd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:12.729852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 768/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:12.742344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203630e8-649c-4c4c-81c8-4cb62ebc6e25 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:12.743131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203630e8-649c-4c4c-81c8-4cb62ebc6e25 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:12.743609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203630e8-649c-4c4c-81c8-4cb62ebc6e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:12.767511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-203630e8-649c-4c4c-81c8-4cb62ebc6e25 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:12.768800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-203630e8-649c-4c4c-81c8-4cb62ebc6e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:12.778242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 749/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:12.942423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec8b32-2ae8-4db1-9cfa-d01dac4219fd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:12.961859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec8b32-2ae8-4db1-9cfa-d01dac4219fd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:12.971273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df188766-67f2-4ed2-8772-f9db5208deef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:12.972309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df188766-67f2-4ed2-8772-f9db5208deef service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:12.972757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df188766-67f2-4ed2-8772-f9db5208deef service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:12.973788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df188766-67f2-4ed2-8772-f9db5208deef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:12.990188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df188766-67f2-4ed2-8772-f9db5208deef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:12.993512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df188766-67f2-4ed2-8772-f9db5208deef service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:13.012622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 769/1518] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:59:20.955711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6c91-d539-496e-80d5-6c0e8d467ab7 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:20.956341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6c91-d539-496e-80d5-6c0e8d467ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:20.956341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6c91-d539-496e-80d5-6c0e8d467ab7 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:20.958270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 750/1519] 10.222.0.50 () {54 vars in 961 bytes} [Wed Sep 14 12:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:20.965288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbf4f-99b8-40f7-aa67-bf875cea0657 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:20.965839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbf4f-99b8-40f7-aa67-bf875cea0657 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:20.965839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dbf4f-99b8-40f7-aa67-bf875cea0657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:20.988677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-561dbf4f-99b8-40f7-aa67-bf875cea0657 None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:20.989954 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-561dbf4f-99b8-40f7-aa67-bf875cea0657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:20.998673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 770/1520] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Sep 14 12:59:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:21.007302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6c91-d539-496e-80d5-6c0e8d467ab7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:21.024563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6c91-d539-496e-80d5-6c0e8d467ab7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:21.027084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f224514-5f2b-4978-afdf-03f60c2ee1f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:21.027703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f224514-5f2b-4978-afdf-03f60c2ee1f1 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:21.027983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f224514-5f2b-4978-afdf-03f60c2ee1f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:21.028551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f224514-5f2b-4978-afdf-03f60c2ee1f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:21.038201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f224514-5f2b-4978-afdf-03f60c2ee1f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:21.039812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f224514-5f2b-4978-afdf-03f60c2ee1f1 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:21.050271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 751/1521] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:59:24.585708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62bdd-02f2-4671-b352-7d3e04a8f5c5 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:24.586376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62bdd-02f2-4671-b352-7d3e04a8f5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:24.586376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea62bdd-02f2-4671-b352-7d3e04a8f5c5 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:24.587717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:24.594818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e304fe-3ff4-4bb9-bedc-7aeae0cbba2e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:24.595371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e304fe-3ff4-4bb9-bedc-7aeae0cbba2e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:24.595371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e304fe-3ff4-4bb9-bedc-7aeae0cbba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:24.617436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-42e304fe-3ff4-4bb9-bedc-7aeae0cbba2e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:24.618658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-42e304fe-3ff4-4bb9-bedc-7aeae0cbba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:24.626646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:24.789030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62bdd-02f2-4671-b352-7d3e04a8f5c5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:24.809612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea62bdd-02f2-4671-b352-7d3e04a8f5c5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:24.816156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ea56a-9734-4736-9754-9af025ae1dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:24.816941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea56a-9734-4736-9754-9af025ae1dd2 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:24.817182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea56a-9734-4736-9754-9af025ae1dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:24.817355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ea56a-9734-4736-9754-9af025ae1dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:24.826668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea56a-9734-4736-9754-9af025ae1dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:24.828303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ea56a-9734-4736-9754-9af025ae1dd2 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:24.839176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 772/1524] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:59:25.982744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f77d-2908-4948-b060-410202dc0770 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:25.983345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f77d-2908-4948-b060-410202dc0770 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:25.983345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d93f77d-2908-4948-b060-410202dc0770 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:25.984692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Sep 14 12:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 12:59:25.993102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59a95-abf3-43d9-9881-828586d1290a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:25.993679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59a95-abf3-43d9-9881-828586d1290a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:25.993679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59a95-abf3-43d9-9881-828586d1290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:26.017287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-61e59a95-abf3-43d9-9881-828586d1290a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:26.018520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-61e59a95-abf3-43d9-9881-828586d1290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:26.026565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Sep 14 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:26.188940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f77d-2908-4948-b060-410202dc0770 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:26.209989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d93f77d-2908-4948-b060-410202dc0770 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:26.215617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71142c-53e2-4266-9661-b6bc383ca84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:26.216254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71142c-53e2-4266-9661-b6bc383ca84e service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:26.216527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71142c-53e2-4266-9661-b6bc383ca84e service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:26.216806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71142c-53e2-4266-9661-b6bc383ca84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:26.226907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71142c-53e2-4266-9661-b6bc383ca84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:26.228545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71142c-53e2-4266-9661-b6bc383ca84e service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:26.238629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 754/1527] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:59:30.561746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92828e64-7e25-4ca1-b9dc-604842c595bc None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:30.562331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92828e64-7e25-4ca1-b9dc-604842c595bc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:30.562331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92828e64-7e25-4ca1-b9dc-604842c595bc None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:30.563528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:30.569840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf0b39-c6d9-4dab-af4b-12c5297426e6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:30.570313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf0b39-c6d9-4dab-af4b-12c5297426e6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:30.570422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf0b39-c6d9-4dab-af4b-12c5297426e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:30.595460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a6cf0b39-c6d9-4dab-af4b-12c5297426e6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:30.596708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6cf0b39-c6d9-4dab-af4b-12c5297426e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:30.607827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 12:59:30.919220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92828e64-7e25-4ca1-b9dc-604842c595bc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:30.920965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-92828e64-7e25-4ca1-b9dc-604842c595bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:30.959054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:59:31.012518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92828e64-7e25-4ca1-b9dc-604842c595bc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:31.016166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f98729-56ce-4dd2-b5e7-28f1fe74d62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:31.016786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98729-56ce-4dd2-b5e7-28f1fe74d62a service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:31.017066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98729-56ce-4dd2-b5e7-28f1fe74d62a service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:31.017340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f98729-56ce-4dd2-b5e7-28f1fe74d62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:31.027089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f98729-56ce-4dd2-b5e7-28f1fe74d62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:31.028862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f98729-56ce-4dd2-b5e7-28f1fe74d62a service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:31.040323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 775/1530] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:59:33.280724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03c9a-bfdb-4b12-967c-be15e0744a53 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:33.281304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03c9a-bfdb-4b12-967c-be15e0744a53 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:33.281304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a03c9a-bfdb-4b12-967c-be15e0744a53 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:33.282518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:33.288257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39108-b1e0-48f4-b17a-33070cceacc8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:33.288768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39108-b1e0-48f4-b17a-33070cceacc8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:33.288931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c39108-b1e0-48f4-b17a-33070cceacc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:33.309285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f2c39108-b1e0-48f4-b17a-33070cceacc8 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:33.310490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f2c39108-b1e0-48f4-b17a-33070cceacc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:33.319305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:33.615946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a03c9a-bfdb-4b12-967c-be15e0744a53 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:33.627827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a03c9a-bfdb-4b12-967c-be15e0744a53 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:33.633184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55786961-9a43-4ce6-82ad-324335cf2f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:33.633796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55786961-9a43-4ce6-82ad-324335cf2f55 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:33.634077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55786961-9a43-4ce6-82ad-324335cf2f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:33.634348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55786961-9a43-4ce6-82ad-324335cf2f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:33.652916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55786961-9a43-4ce6-82ad-324335cf2f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:33.654650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55786961-9a43-4ce6-82ad-324335cf2f55 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:33.665341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 757/1533] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:59:37.870341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ac8c-55fc-408c-9576-dd00c892244e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:37.870883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ac8c-55fc-408c-9576-dd00c892244e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:37.870883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635ac8c-55fc-408c-9576-dd00c892244e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:37.872192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:37.880788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f35e-b3d5-4904-bf92-68fc7f465e67 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:37.881293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f35e-b3d5-4904-bf92-68fc7f465e67 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:37.881593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5f35e-b3d5-4904-bf92-68fc7f465e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:37.906945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-10f5f35e-b3d5-4904-bf92-68fc7f465e67 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:37.908187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-10f5f35e-b3d5-4904-bf92-68fc7f465e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:37.916808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:38.226284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ac8c-55fc-408c-9576-dd00c892244e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:38.226516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b635ac8c-55fc-408c-9576-dd00c892244e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:38.312511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635ac8c-55fc-408c-9576-dd00c892244e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:38.316124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31d442-1205-4e95-b7cc-9cda26568c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:38.317457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31d442-1205-4e95-b7cc-9cda26568c44 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:38.317759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31d442-1205-4e95-b7cc-9cda26568c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:38.318034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31d442-1205-4e95-b7cc-9cda26568c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:38.327772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31d442-1205-4e95-b7cc-9cda26568c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:38.329253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31d442-1205-4e95-b7cc-9cda26568c44 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:38.339760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 778/1536] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 12:59:40.577888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878f73-0d2c-4cd9-895b-6708f30743ef None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:40.578451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878f73-0d2c-4cd9-895b-6708f30743ef None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:40.578451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3878f73-0d2c-4cd9-895b-6708f30743ef None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:40.579861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Sep 14 12:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 12:59:40.586922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697e54b-f99c-49e6-a5c1-e798ab460f13 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:40.587397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697e54b-f99c-49e6-a5c1-e798ab460f13 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:40.587496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697e54b-f99c-49e6-a5c1-e798ab460f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:40.611704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8697e54b-f99c-49e6-a5c1-e798ab460f13 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 12:59:40.613110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8697e54b-f99c-49e6-a5c1-e798ab460f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:40.621275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Sep 14 12:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 12:59:40.924731 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878f73-0d2c-4cd9-895b-6708f30743ef None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 12:59:40.928633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3878f73-0d2c-4cd9-895b-6708f30743ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 12:59:40.943691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3878f73-0d2c-4cd9-895b-6708f30743ef None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 12:59:40.947844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fb49f-4def-428e-9929-9c3b11dfaff2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 12:59:40.948491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fb49f-4def-428e-9929-9c3b11dfaff2 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 12:59:40.948772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fb49f-4def-428e-9929-9c3b11dfaff2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 12:59:40.949042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fb49f-4def-428e-9929-9c3b11dfaff2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 12:59:40.959195 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fb49f-4def-428e-9929-9c3b11dfaff2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 12:59:40.960695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fb49f-4def-428e-9929-9c3b11dfaff2 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 12:59:40.971607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 760/1539] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 12:59:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 12:59:50.606483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=63 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 12:59:50.966925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=37 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:10.268855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b1b05-4b55-41f9-a2b4-ab03853113b1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.269807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b1b05-4b55-41f9-a2b4-ab03853113b1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.269807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b1b05-4b55-41f9-a2b4-ab03853113b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.296444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5a9b1b05-4b55-41f9-a2b4-ab03853113b1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:10.297708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5a9b1b05-4b55-41f9-a2b4-ab03853113b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:10.312750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 780/1540] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:01:10.322679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef969-d440-48a7-a395-244d6abb220d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.323607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef969-d440-48a7-a395-244d6abb220d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.323607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef969-d440-48a7-a395-244d6abb220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.352559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ee7ef969-d440-48a7-a395-244d6abb220d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:10.353785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ee7ef969-d440-48a7-a395-244d6abb220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:10.367200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 761/1541] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:01:10.373123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b1b05-4b55-41f9-a2b4-ab03853113b1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:10.401377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b1b05-4b55-41f9-a2b4-ab03853113b1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:10.418284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:10.419236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.419711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.420173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.421335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:10.421692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:10.424810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:10.444877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 781/1542] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:01:10.453088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ef969-d440-48a7-a395-244d6abb220d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:10.468980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ef969-d440-48a7-a395-244d6abb220d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:10.480834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9744e4-d836-4123-9aea-b4c5442b2aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:10.481474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9744e4-d836-4123-9aea-b4c5442b2aca admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.481773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9744e4-d836-4123-9aea-b4c5442b2aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.482052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9744e4-d836-4123-9aea-b4c5442b2aca admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.482664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9744e4-d836-4123-9aea-b4c5442b2aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:10.484932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9744e4-d836-4123-9aea-b4c5442b2aca admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:10.555203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 762/1543] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:10 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:01:10.560162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:10.578762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96245e-71cb-4516-8520-dfa2cd5a2de3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:10.651761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b425b3-5e36-421f-a15b-d908f4538c45 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.653625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b425b3-5e36-421f-a15b-d908f4538c45 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.653625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b425b3-5e36-421f-a15b-d908f4538c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.729532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d3b425b3-5e36-421f-a15b-d908f4538c45 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:10.730776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3b425b3-5e36-421f-a15b-d908f4538c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:10.801156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba499363-63a0-4ad0-82ab-fdebf40d63f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:10.802610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499363-63a0-4ad0-82ab-fdebf40d63f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.803140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499363-63a0-4ad0-82ab-fdebf40d63f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.803511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba499363-63a0-4ad0-82ab-fdebf40d63f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.805581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba499363-63a0-4ad0-82ab-fdebf40d63f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:10.809227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba499363-63a0-4ad0-82ab-fdebf40d63f9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:10.886785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 782/1544] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:10 2022] POST /identity/v3/users => generated 295 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:10.888899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bba61-a669-46eb-ab68-2857f304f1be None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.889359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bba61-a669-46eb-ab68-2857f304f1be None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.889807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2bba61-a669-46eb-ab68-2857f304f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.940049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 763/1545] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:10.942442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b3f73-8953-44f1-9b9f-069f31f6447e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:10.942683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b3f73-8953-44f1-9b9f-069f31f6447e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:10.942970 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b3f73-8953-44f1-9b9f-069f31f6447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:10.965245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0f2bba61-a669-46eb-ab68-2857f304f1be None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:10.970858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f2bba61-a669-46eb-ab68-2857f304f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.004659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 783/1546] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.007194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-385b3f73-8953-44f1-9b9f-069f31f6447e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.009171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bba61-a669-46eb-ab68-2857f304f1be None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.017538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-385b3f73-8953-44f1-9b9f-069f31f6447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.032491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2bba61-a669-46eb-ab68-2857f304f1be None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.035540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 764/1547] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.037373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae795-d751-4218-b8ba-0d1bee24542b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.037706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae795-d751-4218-b8ba-0d1bee24542b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.038002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ae795-d751-4218-b8ba-0d1bee24542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.038802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3562600-b34d-4717-8dfc-f59ea936f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.039434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3562600-b34d-4717-8dfc-f59ea936f1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.039764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3562600-b34d-4717-8dfc-f59ea936f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.040085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3562600-b34d-4717-8dfc-f59ea936f1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.040728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3562600-b34d-4717-8dfc-f59ea936f1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.042347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3562600-b34d-4717-8dfc-f59ea936f1e3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.061981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 784/1548] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:11.062250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f22ae795-d751-4218-b8ba-0d1bee24542b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.064415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f22ae795-d751-4218-b8ba-0d1bee24542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.070530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5c16-9190-4d4c-aa16-fb29e50deafa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.071326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5c16-9190-4d4c-aa16-fb29e50deafa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.072642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf5c16-9190-4d4c-aa16-fb29e50deafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.084605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 765/1549] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.085869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1061-0e97-44e7-8a37-6e0c49ba5c3b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.086271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1061-0e97-44e7-8a37-6e0c49ba5c3b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.086672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca1061-0e97-44e7-8a37-6e0c49ba5c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.113194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aebf5c16-9190-4d4c-aa16-fb29e50deafa None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.114796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aebf5c16-9190-4d4c-aa16-fb29e50deafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.123633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-92ca1061-0e97-44e7-8a37-6e0c49ba5c3b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.124955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-92ca1061-0e97-44e7-8a37-6e0c49ba5c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.127373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 785/1550] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.131005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221b12-f051-4bad-9582-dddad93f6231 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.131814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221b12-f051-4bad-9582-dddad93f6231 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.132515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc221b12-f051-4bad-9582-dddad93f6231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.142826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 766/1551] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.148787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93b77-14a2-45bb-bf8f-15ea0c2b5b6f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.148787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93b77-14a2-45bb-bf8f-15ea0c2b5b6f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.148787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93b77-14a2-45bb-bf8f-15ea0c2b5b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.176243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9ce93b77-14a2-45bb-bf8f-15ea0c2b5b6f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.177554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bc221b12-f051-4bad-9582-dddad93f6231 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.178976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9ce93b77-14a2-45bb-bf8f-15ea0c2b5b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.179595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bc221b12-f051-4bad-9582-dddad93f6231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.192313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 786/1552] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.193856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc221b12-f051-4bad-9582-dddad93f6231 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.196478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 767/1553] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.198833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263dbf-ea44-4525-a1bd-c56a2846f21b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.199399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263dbf-ea44-4525-a1bd-c56a2846f21b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.199829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263dbf-ea44-4525-a1bd-c56a2846f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.207768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc221b12-f051-4bad-9582-dddad93f6231 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.220488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.221921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.222607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.223778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.224290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.227324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.231090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e1263dbf-ea44-4525-a1bd-c56a2846f21b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.232400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e1263dbf-ea44-4525-a1bd-c56a2846f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.245326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 768/1554] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.246175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1263dbf-ea44-4525-a1bd-c56a2846f21b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.253165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 787/1555] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:11.253888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.257458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1263dbf-ea44-4525-a1bd-c56a2846f21b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.268322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.269089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.269462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.269881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.270661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:11.270984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e995a-ab34-4bef-bc1d-c38ed2508e79 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.271783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.272802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 14 13:01:11.272802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: warnings.warn(msg) Sep 14 13:01:11.272802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: Sep 14 13:01:11.273975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.277123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d83b60d-4c36-4d2b-a5cb-be9569e8eb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.277752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83b60d-4c36-4d2b-a5cb-be9569e8eb88 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.278027 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83b60d-4c36-4d2b-a5cb-be9569e8eb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.278569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d83b60d-4c36-4d2b-a5cb-be9569e8eb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.279224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83b60d-4c36-4d2b-a5cb-be9569e8eb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:11.279527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83b60d-4c36-4d2b-a5cb-be9569e8eb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.281195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d83b60d-4c36-4d2b-a5cb-be9569e8eb88 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.289618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 769/1556] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:11.290726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.310315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 788/1557] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:11.310315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5cc2e-b915-481f-b395-77e6b1e1a193 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.310315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5cc2e-b915-481f-b395-77e6b1e1a193 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.310315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5cc2e-b915-481f-b395-77e6b1e1a193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.310786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abb51f-a59f-4147-adfc-6ac2b16cabb1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.319931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dffdc-6e2e-4b3e-b025-040eb8ab245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.320548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dffdc-6e2e-4b3e-b025-040eb8ab245e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.321036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dffdc-6e2e-4b3e-b025-040eb8ab245e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.321491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dffdc-6e2e-4b3e-b025-040eb8ab245e admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.322267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dffdc-6e2e-4b3e-b025-040eb8ab245e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:11.322597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dffdc-6e2e-4b3e-b025-040eb8ab245e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.324348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dffdc-6e2e-4b3e-b025-040eb8ab245e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.329298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-63e5cc2e-b915-481f-b395-77e6b1e1a193 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.330562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63e5cc2e-b915-481f-b395-77e6b1e1a193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.339660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 789/1558] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.341196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 770/1559] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:11.341897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acb2ae-0527-4609-9c71-3d07f4e5676e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.342241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acb2ae-0527-4609-9c71-3d07f4e5676e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.342843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acb2ae-0527-4609-9c71-3d07f4e5676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.347572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984070-cc1f-4a30-b67e-61aee49216ae None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.348774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984070-cc1f-4a30-b67e-61aee49216ae None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.349548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e984070-cc1f-4a30-b67e-61aee49216ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.366085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-46acb2ae-0527-4609-9c71-3d07f4e5676e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.367333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-46acb2ae-0527-4609-9c71-3d07f4e5676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.378933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 790/1560] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.379845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acb2ae-0527-4609-9c71-3d07f4e5676e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.382768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8e984070-cc1f-4a30-b67e-61aee49216ae None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.384212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8e984070-cc1f-4a30-b67e-61aee49216ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.391178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46acb2ae-0527-4609-9c71-3d07f4e5676e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.398612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 771/1561] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.398886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.399341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.399507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984070-cc1f-4a30-b67e-61aee49216ae None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.399634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.399970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.400687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:11.400995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.402766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.418190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e984070-cc1f-4a30-b67e-61aee49216ae None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.424892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 791/1562] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:11.426331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.430819 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.431976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.432497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.432972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] PATH_INFO: `/v3/projects/7ed2f7beca7f4456ab68ef1f53a58d67/users/df16e3ecae574db7a79d7a1d5b825336/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.445960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169224be-3be9-4902-889c-f42b92963d87 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.455996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.457147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.457667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.458065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.459319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.461154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 13:01:11.461154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 13:01:11.461154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 13:01:11.462205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed2f7beca7f4456ab68ef1f53a58d67, user_id=df16e3ecae574db7a79d7a1d5b825336, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.462923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.464984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.481136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 772/1563] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:11 2022] PUT /identity/v3/projects/7ed2f7beca7f4456ab68ef1f53a58d67/users/df16e3ecae574db7a79d7a1d5b825336/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:11.481991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.507775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 792/1564] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:11.508786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.530396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:11.563169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:11.572603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494f26-36e9-46fe-aaf8-adf08d2cbec4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.618170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9aa24-ad47-4079-b2bd-cf219cc0703e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.626353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.627119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.627482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.627952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.629736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:11.642191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.642191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.662324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc11fab-286e-496c-bd75-f24057a0624c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.662997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11fab-286e-496c-bd75-f24057a0624c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.663280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11fab-286e-496c-bd75-f24057a0624c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.663609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc11fab-286e-496c-bd75-f24057a0624c admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.664326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc11fab-286e-496c-bd75-f24057a0624c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.668196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc11fab-286e-496c-bd75-f24057a0624c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.670703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 793/1565] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:11.671569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.686778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a58d4-6c91-4c10-8f26-d2aaf1ee5f86 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.695590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fea79a-ea01-442c-95af-5078a20bb1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.696732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea79a-ea01-442c-95af-5078a20bb1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.697153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea79a-ea01-442c-95af-5078a20bb1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.697437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fea79a-ea01-442c-95af-5078a20bb1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.698190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fea79a-ea01-442c-95af-5078a20bb1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.700174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fea79a-ea01-442c-95af-5078a20bb1c6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.706040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 773/1566] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/projects => generated 379 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:11.708437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be320d7-eb8d-4a19-94d7-38387947103d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.708437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be320d7-eb8d-4a19-94d7-38387947103d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.708437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be320d7-eb8d-4a19-94d7-38387947103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.740427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 794/1567] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:11.740427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7d5c3-9721-4a29-b212-e2c615959ebb None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.740427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7d5c3-9721-4a29-b212-e2c615959ebb None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.740427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7d5c3-9721-4a29-b212-e2c615959ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.741535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4be320d7-eb8d-4a19-94d7-38387947103d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.744561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4be320d7-eb8d-4a19-94d7-38387947103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.760823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6ef7d5c3-9721-4a29-b212-e2c615959ebb None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.762104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ef7d5c3-9721-4a29-b212-e2c615959ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.841965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 774/1568] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.843347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be320d7-eb8d-4a19-94d7-38387947103d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.860434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be320d7-eb8d-4a19-94d7-38387947103d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.866245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:11.866951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.867244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.867629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.867871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 795/1569] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.868320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:11.869222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dda9ee-8c6b-4782-b672-ffe22d4f0c17 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:11.869492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dda9ee-8c6b-4782-b672-ffe22d4f0c17 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:11.869773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dda9ee-8c6b-4782-b672-ffe22d4f0c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:11.870261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:11.895309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b1dda9ee-8c6b-4782-b672-ffe22d4f0c17 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:11.897305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b1dda9ee-8c6b-4782-b672-ffe22d4f0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:11.909763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 796/1570] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:11.911339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dda9ee-8c6b-4782-b672-ffe22d4f0c17 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.919082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 775/1571] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/projects => generated 401 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:11.921163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:11.928722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dda9ee-8c6b-4782-b672-ffe22d4f0c17 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:11.995344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:12.011966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.012617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.012912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.013179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.013849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.015839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.022588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a568c1-02c2-4da6-9bf4-5ac79f0a7509 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.027903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.028865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.029163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.029524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.030383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.032879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.056215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 797/1572] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.057559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.070474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea514ef-eac1-425c-bbff-53d0ea251b21 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.078599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 776/1573] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:11 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.078599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.079623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.080921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.081425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.081930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.083185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.086992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.120629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 798/1574] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/users => generated 290 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.121764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.131857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:12.137371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ef955-c1c5-45d2-9aeb-b0a337ca5f1b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.161625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05bf68-08a4-42a3-b888-9ea968640a80 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.169139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.170300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.170789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.171278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.172450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.175275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 13:01:12.175275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: warnings.warn(msg) Sep 14 13:01:12.175275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: Sep 14 13:01:12.177583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.215936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 777/1575] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/users => generated 282 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.217428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.222172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.222800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.223077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.223354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.224053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:12.224421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.226053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.234411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba43d57-3426-4a85-ba27-8265ce3bd462 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.241174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.241835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.242116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.242305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 799/1576] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:12.249872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.250008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.250102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:12.250102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.250102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.263140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8ce86-e68f-4b0c-8840-f46ae260badd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.264712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 778/1577] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:12.265558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.269571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.270199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.270956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.270956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.271614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.273483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.302434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 800/1578] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/users => generated 301 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.303310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.313511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e568ec-9107-4a75-b214-0ea3a4e150e4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.318873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.319478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.319750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.320030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.320681 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.322297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.334363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 801/1579] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.335525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.343486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c55d5-d532-4a17-9049-1886ef763f8f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.346752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7309b-81d3-460c-a1bb-025e5438eebe admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.348751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.349491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.349877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.350256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.352464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.353061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.353347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.353616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.354260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.356216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.361788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.363276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.375802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 779/1580] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:12.376634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.386672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f661a-031a-4c92-967c-742361e9411c service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.395493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 802/1581] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/users => generated 283 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.395493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.397545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.398254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.398605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.399306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.400410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.402523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.405519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21587ff8-0f84-453c-bdb9-f20ec1328f7d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.413296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.413875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.414161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.414434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.415091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.416884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.417540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 780/1582] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.418340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.429994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe92881-f0be-484d-b9b8-2671d17cca91 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.431330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 803/1583] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.432224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.441734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.442776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.444341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.444341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.445442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.445643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bab80-9172-4b31-8b1b-5a8b0bfa6bde admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.449312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.453659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.455421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.455850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.456425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.457497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.460784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.502806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 781/1584] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.503815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.519318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 804/1585] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.521842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.539477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:12.613153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9d1f0-fd23-48b9-b86c-68b921a1c9ee admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.662541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b405ff5-952e-4b02-8b07-2e36cdf77eb9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.679406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.681015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.681773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.682271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.683650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.687545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.719404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 805/1586] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.721632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.735779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.737087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.737396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.737726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.738564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.740589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.741451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128b663-a212-44a2-bd6c-bd70a7238b57 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.752813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.753849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.758034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.758212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 782/1587] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.758336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.758476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.758584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.759254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.770696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15ee92-e186-47de-a619-94f4d80e8562 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.777471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.777669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.777898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.778154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.779474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.783581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.783752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 806/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.783752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.797405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:12.806915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 783/1589] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.806915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.807309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83219dfc-5f92-4e77-897a-b0783ac04043 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.822295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeb503-4624-4c4a-bde8-7f1eb91f1743 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.829606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.830436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.830713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.830853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.831213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.831935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.832090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.832926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.835378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.835901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.842478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.845312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.862725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 807/1590] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.863466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.877787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8e688-ef24-4846-b3dd-036f33f11e9e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.885486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.885767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.886364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.886690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.887719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.892123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.896931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 784/1591] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.899791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.924786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe92543-7403-47eb-b413-93366ba17324 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.935513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.937271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.937783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.938601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 808/1592] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:12 2022] POST /identity/v3/users => generated 289 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:12.938930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] PATH_INFO: `/v3/projects/ab10015fc6334c5cb7bd356a68f42c75/users/33ba92af52134e7aadd45d4503bb0b2a/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.939664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:12.955418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c494e2-f448-4d9a-be18-d3765d12a160 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:12.962010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:12.962900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:12.963187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:12.963506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:12.964373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.966545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.975562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab10015fc6334c5cb7bd356a68f42c75, user_id=33ba92af52134e7aadd45d4503bb0b2a, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:12.981634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:12.987197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 809/1593] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:12.987197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.005485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52ddfb-3544-4a2c-8dc9-18aa4da5071b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.022820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 785/1594] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:12 2022] PUT /identity/v3/projects/ab10015fc6334c5cb7bd356a68f42c75/users/33ba92af52134e7aadd45d4503bb0b2a/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:13.030365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.179181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5bf67-1f9c-435c-ab95-bc90a9132578 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.180836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.182224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.182736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.183243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.184551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.185603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.186469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.187023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.187641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] PATH_INFO: `/v3/projects/0f914b0af855494982bfcceb898b3c6c/users/805b09cc83c34399992003295c5a6e9e/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.188315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:13.202851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:13.209580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f914b0af855494982bfcceb898b3c6c, user_id=805b09cc83c34399992003295c5a6e9e, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.213818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:13.214420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 810/1595] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:13.216364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.239552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 786/1596] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:13 2022] PUT /identity/v3/projects/0f914b0af855494982bfcceb898b3c6c/users/805b09cc83c34399992003295c5a6e9e/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:13.241146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.241397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e0900-3b72-4d6c-a471-97d9d0cf1da7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.360447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.363751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.364362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.364932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] PATH_INFO: `/v3/projects/7e6640c93ea0406ebcb23c62526de429/users/ad5717d42bd44ff0861ea6dc5d1524c3/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.375373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e0722-d9cc-4458-8d9d-929c2170d200 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.388508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.390158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.390441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.390781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.393330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.395351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:13.404598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6640c93ea0406ebcb23c62526de429, user_id=ad5717d42bd44ff0861ea6dc5d1524c3, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.405938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 13:01:13.405938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 13:01:13.405938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 13:01:13.408105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 787/1597] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:13.410960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:13.416250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.424279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75046d50-7d5c-4abb-a436-e84cae2dd37c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.436176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 811/1598] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:13 2022] PUT /identity/v3/projects/7e6640c93ea0406ebcb23c62526de429/users/ad5717d42bd44ff0861ea6dc5d1524c3/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:13.436176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.550429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9117d2-b4dd-4ae0-84dd-a7cd698d356e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.551453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9117d2-b4dd-4ae0-84dd-a7cd698d356e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.551900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9117d2-b4dd-4ae0-84dd-a7cd698d356e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.552373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9117d2-b4dd-4ae0-84dd-a7cd698d356e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.554223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9117d2-b4dd-4ae0-84dd-a7cd698d356e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.557049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9117d2-b4dd-4ae0-84dd-a7cd698d356e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:13.565065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:13.591207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 788/1599] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:13.593794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d786-ef5d-48a1-9bfd-69587628551a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.594437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d786-ef5d-48a1-9bfd-69587628551a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.596056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d786-ef5d-48a1-9bfd-69587628551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.644042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4408d786-ef5d-48a1-9bfd-69587628551a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:13.647514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4408d786-ef5d-48a1-9bfd-69587628551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:13.649227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e768fa-c3a7-46a2-a1b5-c41c1984710d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.664397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.666205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.671223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 789/1600] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:13.671223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d786-ef5d-48a1-9bfd-69587628551a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.673400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.674759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] PATH_INFO: `/v3/projects/a1d8251f2b1b44f399081cc91d3983ae/users/d81c3ca6b9d74e9a8c98bfa230e0a883/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.703473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d786-ef5d-48a1-9bfd-69587628551a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.712385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d8251f2b1b44f399081cc91d3983ae, user_id=d81c3ca6b9d74e9a8c98bfa230e0a883, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.716344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87d498-571c-431d-b10c-184c9231e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.717019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d498-571c-431d-b10c-184c9231e0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.717298 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d498-571c-431d-b10c-184c9231e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.717574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87d498-571c-431d-b10c-184c9231e0a0 admin admin] PATH_INFO: `/v3/projects/ed76e8aebbe64240b9acfd18ecb8e9a7/users/44e4e2e40cfd45dfa99162d2afb57f35/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.721210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:13.755704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87d498-571c-431d-b10c-184c9231e0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed76e8aebbe64240b9acfd18ecb8e9a7, user_id=44e4e2e40cfd45dfa99162d2afb57f35, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.757406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87d498-571c-431d-b10c-184c9231e0a0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:13.781120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 790/1601] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:13 2022] PUT /identity/v3/projects/ed76e8aebbe64240b9acfd18ecb8e9a7/users/44e4e2e40cfd45dfa99162d2afb57f35/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:13.783924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32425b7-f04d-4bc3-b169-e3ee1465b89e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.784277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32425b7-f04d-4bc3-b169-e3ee1465b89e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.784558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32425b7-f04d-4bc3-b169-e3ee1465b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.801082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 812/1602] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:13 2022] PUT /identity/v3/projects/a1d8251f2b1b44f399081cc91d3983ae/users/d81c3ca6b9d74e9a8c98bfa230e0a883/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:13.803634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:13.831692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a32425b7-f04d-4bc3-b169-e3ee1465b89e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:13.832912 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a32425b7-f04d-4bc3-b169-e3ee1465b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:13.940760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:13.973086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 791/1603] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:13.973086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b822e-34e0-4f82-a4e4-e157dc55c660 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.973086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b822e-34e0-4f82-a4e4-e157dc55c660 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.973587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b822e-34e0-4f82-a4e4-e157dc55c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.978972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a26f8f-04fc-43bc-953d-c6933aa3ca89 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:13.986393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:13.987097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:13.987517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:13.987929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:13.988794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:13.991096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:14.004763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 813/1604] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:14.005890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:14.017984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31b01-0912-4919-a247-3c67d31c8397 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:14.024625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:14.024625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.025070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.025855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.026598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:14.026885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8c3b822e-34e0-4f82-a4e4-e157dc55c660 None None] MFA Rules not processed for user `ad5717d42bd44ff0861ea6dc5d1524c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:14.028834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:14.029115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c3b822e-34e0-4f82-a4e4-e157dc55c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:14.049472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 814/1605] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:14.049472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:14.049472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:14.158786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3461d2-02f4-492c-befc-d84f5930e0de admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:14.164166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474c2bb-f0dc-4165-a07b-8f8930350ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:14.165215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474c2bb-f0dc-4165-a07b-8f8930350ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.165495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474c2bb-f0dc-4165-a07b-8f8930350ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.165770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474c2bb-f0dc-4165-a07b-8f8930350ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.172286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 792/1606] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:14.177431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfa6d-7ec7-4867-9f3d-2ecf30725103 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.178441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfa6d-7ec7-4867-9f3d-2ecf30725103 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.178775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdfa6d-7ec7-4867-9f3d-2ecf30725103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.189673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474c2bb-f0dc-4165-a07b-8f8930350ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:14.191976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474c2bb-f0dc-4165-a07b-8f8930350ce6 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:14.224399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 815/1607] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:14.226183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51124-bbcb-4d49-a37e-11f1e286cdd9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.226475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51124-bbcb-4d49-a37e-11f1e286cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.226766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51124-bbcb-4d49-a37e-11f1e286cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.231434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8cbdfa6d-7ec7-4867-9f3d-2ecf30725103 None None] MFA Rules not processed for user `44e4e2e40cfd45dfa99162d2afb57f35`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:14.233411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8cbdfa6d-7ec7-4867-9f3d-2ecf30725103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:14.303990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-41c51124-bbcb-4d49-a37e-11f1e286cdd9 None None] MFA Rules not processed for user `d81c3ca6b9d74e9a8c98bfa230e0a883`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:14.305298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-41c51124-bbcb-4d49-a37e-11f1e286cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:14.401180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 793/1608] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:14.401180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdfa6d-7ec7-4867-9f3d-2ecf30725103 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:14.416571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdfa6d-7ec7-4867-9f3d-2ecf30725103 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:14.424904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:14.428172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.429188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.429797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.445865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:14.467824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:14.471816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:14.494238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 794/1609] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:14.495145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:14.508595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d2e1-d70b-4d8a-baa4-d833886902c3 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:14.508899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 816/1610] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:14.512218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51124-bbcb-4d49-a37e-11f1e286cdd9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:14.514811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:14.515586 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.515874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.516204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] PATH_INFO: `/v3/projects/d5bb473e22004be39164fd13e822f02b/users/73e0d98556ae4d2fb9ce0e364be4b4f5/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.541619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bb473e22004be39164fd13e822f02b, user_id=73e0d98556ae4d2fb9ce0e364be4b4f5, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:14.546190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:14.557161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51124-bbcb-4d49-a37e-11f1e286cdd9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:14.581644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 795/1611] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:14 2022] PUT /identity/v3/projects/d5bb473e22004be39164fd13e822f02b/users/73e0d98556ae4d2fb9ce0e364be4b4f5/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:14.586048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:14.720875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:14.804798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8935071-cbf5-4db8-aa34-1f9e95b57a66 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:14.815138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:14.817107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.817773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:14.818423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:14.818715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.818991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.819656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:14.819883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:14.820606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] PATH_INFO: `/v3/projects/66e28aeec3aa4b829924ae12a81a94a5/users/35facb0f8769456d86fc13db4be34dd4/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:14.821695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:14.912261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 796/1612] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:14 2022] POST /identity/v3/projects => generated 363 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:14.912261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:14.923322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e28aeec3aa4b829924ae12a81a94a5, user_id=35facb0f8769456d86fc13db4be34dd4, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:14.926307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:14.962223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 817/1613] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:14 2022] PUT /identity/v3/projects/66e28aeec3aa4b829924ae12a81a94a5/users/35facb0f8769456d86fc13db4be34dd4/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:14.963725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:15.109312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da830f9-15f6-45e6-9d35-7c683722e4a2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:15.155098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef600479-8d34-46a3-b64c-efeecd37e719 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:15.167560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ebd0d-90d4-4aa5-a798-c60229c8cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:15.170140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ebd0d-90d4-4aa5-a798-c60229c8cb11 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.170462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ebd0d-90d4-4aa5-a798-c60229c8cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.170748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ebd0d-90d4-4aa5-a798-c60229c8cb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.171433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ebd0d-90d4-4aa5-a798-c60229c8cb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:15.178419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ebd0d-90d4-4aa5-a798-c60229c8cb11 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:15.232502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:15.233306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.233709 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.234086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.274570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 818/1614] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:14 2022] POST /identity/v3/projects => generated 403 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:15.278603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48bdf9-7307-43b2-bd39-a4e5af3613ee None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.281506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48bdf9-7307-43b2-bd39-a4e5af3613ee None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.284601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48bdf9-7307-43b2-bd39-a4e5af3613ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.412460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:15.414805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:15.425893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ef48bdf9-7307-43b2-bd39-a4e5af3613ee None None] MFA Rules not processed for user `73e0d98556ae4d2fb9ce0e364be4b4f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:15.433372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ef48bdf9-7307-43b2-bd39-a4e5af3613ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:15.441553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 797/1615] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:15.445644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:15.525185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9aab2-1649-4b8e-91c3-a741df8196e7 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:15.562235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:15.601722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:15.642334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:15.643404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.643930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.644501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.646955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:15.651004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:15.691911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 819/1616] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:15.696346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 798/1617] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:15 2022] POST /identity/v3/users => generated 288 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:15.696346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:15.698405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb70dd-8b28-4252-97c7-d59e375f8e74 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.698771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb70dd-8b28-4252-97c7-d59e375f8e74 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.699059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb70dd-8b28-4252-97c7-d59e375f8e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.726395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138a421-f2fa-4543-b731-9b58102e7cfe admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:15.740497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:15.741934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.742312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.744072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.745400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:15.753515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-86bb70dd-8b28-4252-97c7-d59e375f8e74 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:15.753783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:15.758481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-86bb70dd-8b28-4252-97c7-d59e375f8e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:15.784544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 820/1618] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:15.791163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb70dd-8b28-4252-97c7-d59e375f8e74 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:15.816441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 799/1619] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:15 2022] POST /identity/v3/users => generated 308 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:15.817404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:15.821820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb70dd-8b28-4252-97c7-d59e375f8e74 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:15.834259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:15.834928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.835211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.835486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.836229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:15.838097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:15.843632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c28e4-8ac1-4339-9e65-db0516e1156f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:15.852155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:15.852793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:15.853250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:15.853532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:15.854186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:15.856337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:15.882688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 821/1620] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:15.882688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:15.900311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 800/1621] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:15 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:15.901333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:16.114410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117836c3-479a-436c-8aa9-4034265aaff7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:16.122816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:16.123688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:16.124199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:16.124841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:16.126272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:16.131349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:16.143027 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a206e1-2586-4377-9452-4e48630cd1ae admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:16.162565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 801/1622] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:16.170874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:16.210055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4b721-1a7e-4028-8e08-1f95bf145458 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:16.224077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:16.225152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:16.225536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:16.225959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] PATH_INFO: `/v3/projects/11383ed41e90401aa50d22e1893a36a7/users/6cab3c9dda8d4deba2b7720aaa5c03e8/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:16.268637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=11383ed41e90401aa50d22e1893a36a7, user_id=6cab3c9dda8d4deba2b7720aaa5c03e8, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:16.272190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:16.312919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 802/1623] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:16 2022] PUT /identity/v3/projects/11383ed41e90401aa50d22e1893a36a7/users/6cab3c9dda8d4deba2b7720aaa5c03e8/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:16.316411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:16.320892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:16.321544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:16.321826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:16.322103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:16.346690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:16.348210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:16.370704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 822/1624] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:16.371419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:16.396964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afab1aa-4219-41ff-8013-cac64c2136e4 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:16.482825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:16.519164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78c621-8c98-4dbb-9788-bc4b5063e3fc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:16.532566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:16.534102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:16.534885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:16.535293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:16.536567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:16.541242 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:16.577868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:16.581222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:16.581949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:16.606366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 803/1625] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:16 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:16.608818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:16.620978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] PATH_INFO: `/v3/projects/88a14346adc044698df23acd26811441/users/8d859ccd15df4f01a3ba2776d52d3d05/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:16.639706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84550a5-a9c1-4bf9-9679-306466740375 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:16.662974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:16.664755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:16.665678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:16.666379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:16.667995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:16.671580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:16.702495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a14346adc044698df23acd26811441, user_id=8d859ccd15df4f01a3ba2776d52d3d05, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:16.713201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:16.761280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 804/1626] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:16.762877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:16.765153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 823/1627] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:16 2022] PUT /identity/v3/projects/88a14346adc044698df23acd26811441/users/8d859ccd15df4f01a3ba2776d52d3d05/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:16.766789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:16.806356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7de18-0284-4f80-97a3-d66b4d9bbc15 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:16.826361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:16.997707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fe327-b681-40f7-9d47-af6b3d0d090e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:17.036058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:17.036828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.037751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.037751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] PATH_INFO: `/v3/projects/11383ed41e90401aa50d22e1893a36a7/users/6cab3c9dda8d4deba2b7720aaa5c03e8/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.046033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11383ed41e90401aa50d22e1893a36a7, user_id=6cab3c9dda8d4deba2b7720aaa5c03e8, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:17.050378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:17.078705 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 824/1628] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:16 2022] PUT /identity/v3/projects/11383ed41e90401aa50d22e1893a36a7/users/6cab3c9dda8d4deba2b7720aaa5c03e8/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:17.081088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:17.117231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb17f9-d3e3-4fb1-b2d7-2d9ae280badd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:17.118325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb17f9-d3e3-4fb1-b2d7-2d9ae280badd admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.118834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb17f9-d3e3-4fb1-b2d7-2d9ae280badd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.119334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb17f9-d3e3-4fb1-b2d7-2d9ae280badd admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.128342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb17f9-d3e3-4fb1-b2d7-2d9ae280badd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:17.132745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb17f9-d3e3-4fb1-b2d7-2d9ae280badd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:17.181830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 805/1629] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:17.186109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f979b61-5977-4437-b88c-001206fb36f3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.186958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f979b61-5977-4437-b88c-001206fb36f3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.187454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f979b61-5977-4437-b88c-001206fb36f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.275557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9f979b61-5977-4437-b88c-001206fb36f3 None None] MFA Rules not processed for user `6cab3c9dda8d4deba2b7720aaa5c03e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:17.278622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9f979b61-5977-4437-b88c-001206fb36f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:17.296653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d2732-f035-4e1f-8d14-17e563d0cf4a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:17.306280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:17.307183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.307607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.309445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.311123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:17.315171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:17.340252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 825/1630] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:17.341638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:17.355400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee747c4-76cb-448c-b9c5-fd7a47fc2187 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:17.363769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:17.364439 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.364772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.365053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.365977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:17.367834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:17.384348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 826/1631] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:17.388609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:17.406361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741c242-1aa1-4b71-a6c1-206fa9743b6f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:17.424918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:17.425774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.426065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.426418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] PATH_INFO: `/v3/projects/88a14346adc044698df23acd26811441/users/8d859ccd15df4f01a3ba2776d52d3d05/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.429153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a14346adc044698df23acd26811441, user_id=8d859ccd15df4f01a3ba2776d52d3d05, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:17.436842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:17.481544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 827/1632] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:17 2022] PUT /identity/v3/projects/88a14346adc044698df23acd26811441/users/8d859ccd15df4f01a3ba2776d52d3d05/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:17.484167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:17.523904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 806/1633] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:17.528548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509851d-addb-48c3-bb34-033c57a66bdc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.529163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509851d-addb-48c3-bb34-033c57a66bdc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.529754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509851d-addb-48c3-bb34-033c57a66bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.602655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2509851d-addb-48c3-bb34-033c57a66bdc None None] MFA Rules not processed for user `8d859ccd15df4f01a3ba2776d52d3d05`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:17.604960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2509851d-addb-48c3-bb34-033c57a66bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:17.695157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d807294-a8d1-4d05-a07c-1ceba1371e54 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:17.714081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:17.720146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:17.722781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.723036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.723408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] PATH_INFO: `/v3/projects/6f2aa2eb4c2f428085a11a0106e7cc38/users/f5f01db469f34cafa5cf3195068c5dfe/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.757854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2aa2eb4c2f428085a11a0106e7cc38, user_id=f5f01db469f34cafa5cf3195068c5dfe, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:17.761503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:17.767549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:17.795409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 828/1634] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:17 2022] PUT /identity/v3/projects/6f2aa2eb4c2f428085a11a0106e7cc38/users/f5f01db469f34cafa5cf3195068c5dfe/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:17.796354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:17.826865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 807/1635] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:17.827928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46623fb-d923-47ff-bb41-b4c134d23d8d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.828246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46623fb-d923-47ff-bb41-b4c134d23d8d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:17.828521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46623fb-d923-47ff-bb41-b4c134d23d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:17.903571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f46623fb-d923-47ff-bb41-b4c134d23d8d None None] MFA Rules not processed for user `f5f01db469f34cafa5cf3195068c5dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:17.904998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f46623fb-d923-47ff-bb41-b4c134d23d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:17.989525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de00967-9072-467a-85c9-e581e3fd1462 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:17.996346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:17.997110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:17.997402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.001445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:18.078324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 808/1636] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:18.082241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46623fb-d923-47ff-bb41-b4c134d23d8d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:18.103946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46623fb-d923-47ff-bb41-b4c134d23d8d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:18.112708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:18.113353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:18.113633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.115097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:18.166970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:18.168717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:18.198693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 829/1637] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:18.199649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:18.311040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:18.314796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:18.346991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 809/1638] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:18 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:18.365184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ca779-498f-40ff-912e-a81727c1b2f3 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:18.398825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:18.399598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:18.399970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.400363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:18.401114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:18.403399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:18.487912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 830/1639] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:18 2022] POST /identity/v3/projects => generated 387 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:18.489262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:18.514662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ccf7c-34cc-4df6-b2f5-dab20da96e5f service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:18.579721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:18.630623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:18.673070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:18.673785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:18.674011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.674220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:18.674696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f758-b805-4f4e-b1c2-fffeca7af099 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:18.675083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:18.677012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:18.680788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:18.682085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:18.682757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.683410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:18.699572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:18.725887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 810/1640] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:18 2022] POST /identity/v3/users => generated 300 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:18.727023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:18.744628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebcdc1-31d0-4059-a588-ba74f3b0625c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:18.810463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:18.810463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:18.810463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.810463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:18.811610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:18.811610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:18.811610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 811/1641] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:01:18.811610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:18.840844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46cf87-9295-404c-bf8e-9a74114fcf35 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:18.857303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:18.858185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:18.859226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.859226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] PATH_INFO: `/v3/users/d81c3ca6b9d74e9a8c98bfa230e0a883` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:18.860837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81c3ca6b9d74e9a8c98bfa230e0a883)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:18.863232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:18.881216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:18.883127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:18.923814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 831/1642] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:18.927514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:18.953276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e0f02-6501-4065-8652-6d43a8350481 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:18.979457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:18.981042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:18.981451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:18.983130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] PATH_INFO: `/v3/projects/37f5cb7b2c684b39a7d2abdbcf8f7c9f/users/f685497b991d4648a0d9157865bfb6b6/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.045056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f5cb7b2c684b39a7d2abdbcf8f7c9f, user_id=f685497b991d4648a0d9157865bfb6b6, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:19.051948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81c3ca6b9d74e9a8c98bfa230e0a883'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:19.053263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81c3ca6b9d74e9a8c98bfa230e0a883'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:19.055447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:19.055600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81c3ca6b9d74e9a8c98bfa230e0a883'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:19.081356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81c3ca6b9d74e9a8c98bfa230e0a883'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:19.092131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 832/1643] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:18 2022] PUT /identity/v3/projects/37f5cb7b2c684b39a7d2abdbcf8f7c9f/users/f685497b991d4648a0d9157865bfb6b6/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:19.097265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:19.101153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:19.135772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-106c1aa4-c45d-4564-87ae-2ab749752e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81c3ca6b9d74e9a8c98bfa230e0a883'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:19.181865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 812/1644] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:18 2022] DELETE /identity/v3/users/d81c3ca6b9d74e9a8c98bfa230e0a883 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:19.183636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c361d-646f-4939-964c-a6cf99784869 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.183636 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c361d-646f-4939-964c-a6cf99784869 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.183792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c361d-646f-4939-964c-a6cf99784869 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.196327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 813/1645] 10.222.0.50 () {54 vars in 962 bytes} [Wed Sep 14 13:01:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:01:19.197425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772eefe-1470-43a8-ab5e-04a2d635cfc3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.197759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772eefe-1470-43a8-ab5e-04a2d635cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.198071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772eefe-1470-43a8-ab5e-04a2d635cfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.251377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b772eefe-1470-43a8-ab5e-04a2d635cfc3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:19.258099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b772eefe-1470-43a8-ab5e-04a2d635cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:19.322745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80c38-9634-4e98-8f6e-5096d41fd166 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:19.461559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:19.462201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.462485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.462769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.463425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:19.463662 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 814/1646] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:19.466492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:19.467048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd36b1-767f-4dc3-82af-ce68f7b6f2e6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.467596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd36b1-767f-4dc3-82af-ce68f7b6f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.468106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd36b1-767f-4dc3-82af-ce68f7b6f2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.501728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 833/1647] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:19.505746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:19.521229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:19.527395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca67e9b-df37-45b4-be28-bd375afd724b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:19.534890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a6fd36b1-767f-4dc3-82af-ce68f7b6f2e6 None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:19.536066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6fd36b1-767f-4dc3-82af-ce68f7b6f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:19.546824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:19.547655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.548481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.548761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] PATH_INFO: `/v3/projects/37f5cb7b2c684b39a7d2abdbcf8f7c9f/users/f685497b991d4648a0d9157865bfb6b6/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.551864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f5cb7b2c684b39a7d2abdbcf8f7c9f, user_id=f685497b991d4648a0d9157865bfb6b6, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:19.554793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:19.588638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 834/1648] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:19 2022] PUT /identity/v3/projects/37f5cb7b2c684b39a7d2abdbcf8f7c9f/users/f685497b991d4648a0d9157865bfb6b6/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:01:19.589816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:19.601417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:19.635271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:19.745318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 815/1649] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Sep 14 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:19.748150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a0c99-fe56-45c3-ac47-f8a3f6f15aa7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.748717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a0c99-fe56-45c3-ac47-f8a3f6f15aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.749237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a0c99-fe56-45c3-ac47-f8a3f6f15aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.791032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f9b9-4efd-449d-bb52-06c884f7316d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:19.803647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1a1df-49ad-4f23-870a-0f3b4943dff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:19.804313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1a1df-49ad-4f23-870a-0f3b4943dff5 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.804756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1a1df-49ad-4f23-870a-0f3b4943dff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.805351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1a1df-49ad-4f23-870a-0f3b4943dff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.805950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-198a0c99-fe56-45c3-ac47-f8a3f6f15aa7 None None] MFA Rules not processed for user `f685497b991d4648a0d9157865bfb6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:19.807701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-198a0c99-fe56-45c3-ac47-f8a3f6f15aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:19.931452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 816/1650] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:19.933244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bde7e3-2173-4221-8423-16f8a3954b5e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.933911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bde7e3-2173-4221-8423-16f8a3954b5e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.934656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bde7e3-2173-4221-8423-16f8a3954b5e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:19.947689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1a1df-49ad-4f23-870a-0f3b4943dff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:19.949409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1a1df-49ad-4f23-870a-0f3b4943dff5 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:19.950076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 817/1651] 10.222.0.50 () {54 vars in 912 bytes} [Wed Sep 14 13:01:19 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:01:19.951158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bde7e3-2173-4221-8423-16f8a3954b5e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:19.953093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-76bde7e3-2173-4221-8423-16f8a3954b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:19.967288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 835/1652] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:19.968641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:19.968925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:19.969193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:20.023330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:20.024792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:20.128146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bde7e3-2173-4221-8423-16f8a3954b5e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:20.136444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:20.137376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:20.137837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:20.138220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:20.193087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:20.195640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:20.226747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 818/1653] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:20.263265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 836/1654] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:20.317027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:20.320836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:20.379518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01147f-9894-4655-a44e-87e54df36f7d service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:20.389080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:20.390154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:20.390779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:20.392611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:20.434219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:20.436271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:20.468521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 819/1655] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:22.352611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:22.354392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:22.395816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaf12b-3950-49f8-8e3d-c63df4b5dc4d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:22.402355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:22.403782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:22.404330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:22.405335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] PATH_INFO: `/v3/projects/a1d8251f2b1b44f399081cc91d3983ae` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:22.408927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d8251f2b1b44f399081cc91d3983ae)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:22.411571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:22.511044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:22.582814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d8251f2b1b44f399081cc91d3983ae', 'request_id': 'req-69400ef9-fa2d-4662-87b2-a66bf67ba73f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:22.593961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d8251f2b1b44f399081cc91d3983ae', 'request_id': 'req-69400ef9-fa2d-4662-87b2-a66bf67ba73f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:22.611222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d8251f2b1b44f399081cc91d3983ae', 'request_id': 'req-69400ef9-fa2d-4662-87b2-a66bf67ba73f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:22.615574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:22.633231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] The token cache is being invalidate because project a1d8251f2b1b44f399081cc91d3983ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:22.634090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:22.635061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:22.635511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff0347-8c98-4a20-bc53-60184737509d service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:22.638333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 837/1656] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:22 2022] DELETE /identity/v3/projects/a1d8251f2b1b44f399081cc91d3983ae => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:22.644524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:22.648081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:22.725260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:22.741026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8268614-153f-4801-9a59-4de60ba1d407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:22.744682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268614-153f-4801-9a59-4de60ba1d407 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:22.745188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268614-153f-4801-9a59-4de60ba1d407 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:22.745697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8268614-153f-4801-9a59-4de60ba1d407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:22.748199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8268614-153f-4801-9a59-4de60ba1d407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:22.784945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400ef9-fa2d-4662-87b2-a66bf67ba73f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:22.813666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:22.814753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:22.815103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:22.816551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] PATH_INFO: `/v3/users/8d859ccd15df4f01a3ba2776d52d3d05` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:22.823566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d859ccd15df4f01a3ba2776d52d3d05)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:22.824782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: WARNING py.warnings [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 13:01:22.824782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: warnings.warn(msg) Sep 14 13:01:22.824782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: Sep 14 13:01:22.826971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:22.892741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8268614-153f-4801-9a59-4de60ba1d407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:22.896892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8268614-153f-4801-9a59-4de60ba1d407 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:22.941661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 820/1657] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:01:23.023963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d859ccd15df4f01a3ba2776d52d3d05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:23.032584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d859ccd15df4f01a3ba2776d52d3d05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:23.034751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d859ccd15df4f01a3ba2776d52d3d05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:23.106726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d859ccd15df4f01a3ba2776d52d3d05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:23.200077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c5be478f-82ca-4ac9-ba0d-1c4056171f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d859ccd15df4f01a3ba2776d52d3d05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:23.229063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 838/1658] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:22 2022] DELETE /identity/v3/users/8d859ccd15df4f01a3ba2776d52d3d05 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:23.960087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32441-b111-4402-a4c9-63b6fb1d3d39 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:23.961081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32441-b111-4402-a4c9-63b6fb1d3d39 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:23.961567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32441-b111-4402-a4c9-63b6fb1d3d39 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:23.963580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 821/1659] 10.222.0.50 () {54 vars in 962 bytes} [Wed Sep 14 13:01:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:01:23.972347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1283-b3fb-4443-b945-6459ff2e8878 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:23.973761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1283-b3fb-4443-b945-6459ff2e8878 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:23.974330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1283-b3fb-4443-b945-6459ff2e8878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:24.021613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b9ef1283-b3fb-4443-b945-6459ff2e8878 None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:24.026475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b9ef1283-b3fb-4443-b945-6459ff2e8878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:24.128371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:24.244309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 839/1660] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Sep 14 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:24.251547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085559c4-ae6e-4612-b7c3-63510cc0cb1e None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:24.251848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085559c4-ae6e-4612-b7c3-63510cc0cb1e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:24.252174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085559c4-ae6e-4612-b7c3-63510cc0cb1e None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:24.254212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 822/1661] 10.222.0.50 () {54 vars in 912 bytes} [Wed Sep 14 13:01:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:01:24.264351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:24.264902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:24.265329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:24.305543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:24.309307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:24.329241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 840/1662] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:24.356372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085559c4-ae6e-4612-b7c3-63510cc0cb1e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:24.358503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-085559c4-ae6e-4612-b7c3-63510cc0cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:24.559462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085559c4-ae6e-4612-b7c3-63510cc0cb1e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:24.566628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc7063-7ecd-49e2-bc14-a990fb3c8c9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:24.567447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7063-7ecd-49e2-bc14-a990fb3c8c9d service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:24.567817 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7063-7ecd-49e2-bc14-a990fb3c8c9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:24.568136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc7063-7ecd-49e2-bc14-a990fb3c8c9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:24.603418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc7063-7ecd-49e2-bc14-a990fb3c8c9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:24.605409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc7063-7ecd-49e2-bc14-a990fb3c8c9d service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:24.659999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 823/1663] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:25.664482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:25.668138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:25.885679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55c88f-3217-4f88-bc27-b0846877a71f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:25.897354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:25.897559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:25.897843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:25.898148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] PATH_INFO: `/v3/projects/88a14346adc044698df23acd26811441` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:25.900392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a14346adc044698df23acd26811441)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:25.902818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:26.101163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a14346adc044698df23acd26811441', 'request_id': 'req-74894603-33ba-4922-a4e9-9227a800cfa7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:26.111729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a14346adc044698df23acd26811441', 'request_id': 'req-74894603-33ba-4922-a4e9-9227a800cfa7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:26.131811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a14346adc044698df23acd26811441', 'request_id': 'req-74894603-33ba-4922-a4e9-9227a800cfa7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:26.157386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] The token cache is being invalidate because project 88a14346adc044698df23acd26811441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:26.157979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:26.163477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-74894603-33ba-4922-a4e9-9227a800cfa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:26.169947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 841/1664] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:25 2022] DELETE /identity/v3/projects/88a14346adc044698df23acd26811441 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:26.170524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1b302-953b-41e0-bcbb-cbb5e3233231 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:26.171065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1b302-953b-41e0-bcbb-cbb5e3233231 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:26.171065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1b302-953b-41e0-bcbb-cbb5e3233231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:26.235047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1fc1b302-953b-41e0-bcbb-cbb5e3233231 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:26.240228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1fc1b302-953b-41e0-bcbb-cbb5e3233231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:26.448278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030cf5-a011-41d6-9f08-111c01e44c31 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:26.448555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 824/1665] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:26.448796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030cf5-a011-41d6-9f08-111c01e44c31 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:26.449087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d030cf5-a011-41d6-9f08-111c01e44c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:26.498568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6d030cf5-a011-41d6-9f08-111c01e44c31 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:26.512682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6d030cf5-a011-41d6-9f08-111c01e44c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:26.536851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 842/1666] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:26.541748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1b302-953b-41e0-bcbb-cbb5e3233231 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:26.557832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1b302-953b-41e0-bcbb-cbb5e3233231 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:26.568565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:26.569408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:26.569695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:26.573816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:26.574648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:26.574963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:26.581431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:26.616856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 825/1667] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:26.618324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d030cf5-a011-41d6-9f08-111c01e44c31 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:26.635340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d030cf5-a011-41d6-9f08-111c01e44c31 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:26.655214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:26.658032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:26.658032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:26.658032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:26.658032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:26.670702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:26.766642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 843/1668] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:26 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:26.768733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:26.806851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505d35-19d0-4eb1-870b-04e70947e263 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:26.876933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:27.036047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:27.036900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:27.037345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:27.037770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:27.038562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:27.041165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:27.099478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 826/1669] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:26 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:27.105058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:27.125538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304cfd4-e50e-4a30-9bdf-04cc2063848b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:27.138750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:27.139767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:27.140318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:27.140827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:27.142018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:27.143971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:27.170614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 844/1670] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:27.171939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:27.185098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17102f-a378-4399-a704-1bf611406e25 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:27.214287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d9d4c-b71d-4c95-aca6-dce22d772d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:27.214981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d9d4c-b71d-4c95-aca6-dce22d772d6c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:27.215264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d9d4c-b71d-4c95-aca6-dce22d772d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:27.215547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d9d4c-b71d-4c95-aca6-dce22d772d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:27.216245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d9d4c-b71d-4c95-aca6-dce22d772d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:27.217869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d9d4c-b71d-4c95-aca6-dce22d772d6c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:27.288575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 827/1671] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:27.289434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:27.304869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c8311-1af2-4312-839f-bdecb0a27019 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:27.334747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:27.335959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:27.336507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:27.337017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] PATH_INFO: `/v3/projects/06271b257aca447da7cab112235388e4/users/9e0ba85681444cb18325afb73a11f063/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:27.348746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:27.367584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] RBAC: Authorizing `identity:create_grant(project_id=06271b257aca447da7cab112235388e4, user_id=9e0ba85681444cb18325afb73a11f063, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:27.370579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:27.411825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 845/1672] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:27 2022] PUT /identity/v3/projects/06271b257aca447da7cab112235388e4/users/9e0ba85681444cb18325afb73a11f063/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:01:27.414640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528e241-271f-48da-8c60-e03d84932463 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:27.415187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528e241-271f-48da-8c60-e03d84932463 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:27.415677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528e241-271f-48da-8c60-e03d84932463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:27.546751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3528e241-271f-48da-8c60-e03d84932463 None None] MFA Rules not processed for user `9e0ba85681444cb18325afb73a11f063`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:27.550410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3528e241-271f-48da-8c60-e03d84932463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:27.790339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 828/1673] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:27.793975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:27.981086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd24ab-8e18-4e20-9811-0bdbd2cb464d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:27.994679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:27.996036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:27.996472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:27.996917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:27.998117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:28.001428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:28.082383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 846/1674] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:27 2022] POST /identity/v3/projects => generated 373 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:28.086847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528e241-271f-48da-8c60-e03d84932463 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:28.159315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528e241-271f-48da-8c60-e03d84932463 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:28.299303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:28.302908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:28.303408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:28.303855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:28.307332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:28.310019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:28.373646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 829/1675] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:28 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:28.379618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:28.406280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203dfe8-a566-4474-a425-9278672ca658 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:28.421288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:28.422313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:28.422830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:28.423286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:28.424507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:28.426528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:28.455594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 847/1676] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:28.458331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:28.475836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563f01a-6085-472e-8e4c-4823451446a3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:28.489622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36de0d-644f-4693-9dfa-0834bbe16c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:28.490711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36de0d-644f-4693-9dfa-0834bbe16c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:28.491244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36de0d-644f-4693-9dfa-0834bbe16c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:28.491820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36de0d-644f-4693-9dfa-0834bbe16c3c admin admin] PATH_INFO: `/v3/projects/f0727184773a4afaa4c38ddad9e242b1/users/09817b138f6d49d9992930e460a80fd5/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:28.540809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36de0d-644f-4693-9dfa-0834bbe16c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0727184773a4afaa4c38ddad9e242b1, user_id=09817b138f6d49d9992930e460a80fd5, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:28.548900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36de0d-644f-4693-9dfa-0834bbe16c3c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:28.596592 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 830/1677] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:28 2022] PUT /identity/v3/projects/f0727184773a4afaa4c38ddad9e242b1/users/09817b138f6d49d9992930e460a80fd5/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:28.600730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:28.631476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606f9d0-4ddf-4c98-b11a-cb781d184707 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:28.795854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:28.796429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:28.796879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:28.820762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:28.876447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:28.878215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:28.879422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:28.879941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:28.883362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:28.885275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:28.906105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] MFA Rules not processed for user `df16e3ecae574db7a79d7a1d5b825336`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:28.908417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:28.929193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 848/1678] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:28.930492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:28.981324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1a90-a8bf-4587-8a1b-0122a6acd3ba admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:28.999739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d6575-e278-4251-a7a0-32fd648d4fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:29.001365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6575-e278-4251-a7a0-32fd648d4fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:29.005181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6575-e278-4251-a7a0-32fd648d4fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:29.007702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d6575-e278-4251-a7a0-32fd648d4fd4 admin admin] PATH_INFO: `/v3/projects/f0727184773a4afaa4c38ddad9e242b1/users/09817b138f6d49d9992930e460a80fd5/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:29.023059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d6575-e278-4251-a7a0-32fd648d4fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0727184773a4afaa4c38ddad9e242b1, user_id=09817b138f6d49d9992930e460a80fd5, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:29.026239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d6575-e278-4251-a7a0-32fd648d4fd4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:29.072191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 849/1679] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:28 2022] PUT /identity/v3/projects/f0727184773a4afaa4c38ddad9e242b1/users/09817b138f6d49d9992930e460a80fd5/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:29.079926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 831/1680] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:01:29.092920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:29.093501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:29.094893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:29.102062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:29.103846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:29.200729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] MFA Rules not processed for user `09817b138f6d49d9992930e460a80fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:29.201994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:29.291897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ecc0a-81aa-4a14-b15c-915f52b47e96 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:29.298038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:29.395865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 850/1681] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:29.405076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:29.409210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:29.493438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:29.493438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:29.493999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:29.494206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:29.567445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dcfd2-4eac-477f-8d3b-9bd848378946 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:29.571288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:29.580838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14563b52-e293-4e3f-903d-eb35e64c5824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:29.582526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14563b52-e293-4e3f-903d-eb35e64c5824 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:29.582982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14563b52-e293-4e3f-903d-eb35e64c5824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:29.583412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14563b52-e293-4e3f-903d-eb35e64c5824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:29.588204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-14563b52-e293-4e3f-903d-eb35e64c5824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:29.677265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:29.679275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:29.709383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 832/1682] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:01:29.710605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:29.713025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:29.738244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705a3fe-121f-4b84-97b1-70e2c1b3c82f service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:29.752429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2916e1f-9ea3-4b8d-98c4-1eab647b96d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:29.753772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2916e1f-9ea3-4b8d-98c4-1eab647b96d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:29.754404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2916e1f-9ea3-4b8d-98c4-1eab647b96d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:29.754840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2916e1f-9ea3-4b8d-98c4-1eab647b96d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:29.777836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2916e1f-9ea3-4b8d-98c4-1eab647b96d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:29.782363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2916e1f-9ea3-4b8d-98c4-1eab647b96d7 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:29.783459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14563b52-e293-4e3f-903d-eb35e64c5824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:29.785197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14563b52-e293-4e3f-903d-eb35e64c5824 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:29.814450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 851/1683] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:29.831099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 833/1684] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:30.375944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:30.376851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:30.379810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:30.466066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] MFA Rules not processed for user `33ba92af52134e7aadd45d4503bb0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:30.468162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:30.563766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc85ec-cf10-482e-9ac3-9db7c59926aa None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:30.564851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc85ec-cf10-482e-9ac3-9db7c59926aa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:30.565312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc85ec-cf10-482e-9ac3-9db7c59926aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:30.628072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6adc85ec-cf10-482e-9ac3-9db7c59926aa None None] MFA Rules not processed for user `805b09cc83c34399992003295c5a6e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:30.629515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6adc85ec-cf10-482e-9ac3-9db7c59926aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:30.695280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 852/1685] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:30.714563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:30.719617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:30.771177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e664d9-13ce-4a0e-8fd3-ea26a6bd0f72 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:30.783863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 834/1686] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:30.796740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:30.798071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:30.798285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:30.799645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:30.799931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:30.800236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:30.800530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:30.830890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:30.832983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:30.846742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:30.852823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] MFA Rules not processed for user `805b09cc83c34399992003295c5a6e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:30.857145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:30.865738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 853/1687] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:01:30.875190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 835/1688] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:30.900706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:30.919177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e0a22-a482-4104-bed2-7330799343f0 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:30.940643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:30.941318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:30.941604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:30.942177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:30.963440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:30.968254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:31.003697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 854/1689] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:31.451420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:31.454038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:31.650318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bb609-a6e4-467e-8c6e-6257c5c0c49a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:31.663525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:31.666131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:31.667052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:31.669865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] PATH_INFO: `/v3/users/ad5717d42bd44ff0861ea6dc5d1524c3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:31.673995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad5717d42bd44ff0861ea6dc5d1524c3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:31.675288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:31.780572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:31.794076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad5717d42bd44ff0861ea6dc5d1524c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:31.795112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad5717d42bd44ff0861ea6dc5d1524c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:31.797071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad5717d42bd44ff0861ea6dc5d1524c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:31.814552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad5717d42bd44ff0861ea6dc5d1524c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:31.854269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-38f8ac08-2535-4090-bf2e-411cd3f8ec0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad5717d42bd44ff0861ea6dc5d1524c3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:31.872612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:31.882325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 836/1690] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:31 2022] DELETE /identity/v3/users/ad5717d42bd44ff0861ea6dc5d1524c3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:31.887012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:31.887619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:31.888363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:31.896120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88351e71-4721-4236-bbea-e9e143ae8d3c service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:31.939597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:31.941201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.060403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:32.063882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.067288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.069160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] PATH_INFO: `/v3/users/9e0ba85681444cb18325afb73a11f063` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:32.077401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0ba85681444cb18325afb73a11f063)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:32.084348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:32.115901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 837/1691] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:01:32.165109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:32.168253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.298640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0ba85681444cb18325afb73a11f063'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.299793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0ba85681444cb18325afb73a11f063'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.300981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0ba85681444cb18325afb73a11f063'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.312207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0ba85681444cb18325afb73a11f063'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.315452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289610c8-a4f5-441b-aed5-5efeff167734 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:32.329553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d93f0-0ca5-4202-981e-057384d9cf52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:32.335235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d93f0-0ca5-4202-981e-057384d9cf52 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.335650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d93f0-0ca5-4202-981e-057384d9cf52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.336502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d93f0-0ca5-4202-981e-057384d9cf52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:32.338947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-071d93f0-0ca5-4202-981e-057384d9cf52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.341848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0ba85681444cb18325afb73a11f063'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.376329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 855/1692] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:31 2022] DELETE /identity/v3/users/9e0ba85681444cb18325afb73a11f063 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:01:32.376942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d93f0-0ca5-4202-981e-057384d9cf52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:32.378076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:32.380091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.382469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d93f0-0ca5-4202-981e-057384d9cf52 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:32.409392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 838/1693] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:32.411190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.414844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.415298 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:32.460577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:32.463194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.568802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dcbe33-278c-400d-90c0-9e0ba94ee549 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:32.585876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:32.586553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.586830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.595597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] PATH_INFO: `/v3/users/44e4e2e40cfd45dfa99162d2afb57f35` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:32.598763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e4e2e40cfd45dfa99162d2afb57f35)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:32.602248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:32.606410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:32.628834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 839/1694] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:32.631091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:32.645258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:32.647165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.732550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e4e2e40cfd45dfa99162d2afb57f35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.733874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e4e2e40cfd45dfa99162d2afb57f35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.735688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e4e2e40cfd45dfa99162d2afb57f35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.748724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e4e2e40cfd45dfa99162d2afb57f35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.787825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4853ebb9-7f99-443b-a7d9-2114ffb38c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e4e2e40cfd45dfa99162d2afb57f35'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:32.809183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fab2c6-67ea-4994-9166-15a7b07fedf5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:32.822380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d936-7617-4644-8765-27e13d2e5e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:32.823400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d936-7617-4644-8765-27e13d2e5e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.823921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d936-7617-4644-8765-27e13d2e5e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.824430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d936-7617-4644-8765-27e13d2e5e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:32.825017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 856/1695] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:32 2022] DELETE /identity/v3/users/44e4e2e40cfd45dfa99162d2afb57f35 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:32.827290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d6f7d936-7617-4644-8765-27e13d2e5e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.831316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.831958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.832687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:32.856842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d936-7617-4644-8765-27e13d2e5e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:32.858416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d936-7617-4644-8765-27e13d2e5e5b service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:32.891753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 840/1696] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:32.893205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db78f-70fc-4c9b-a539-43b6a3e4315f None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.893583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db78f-70fc-4c9b-a539-43b6a3e4315f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.893927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db78f-70fc-4c9b-a539-43b6a3e4315f None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:32.895323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 841/1697] 10.222.0.50 () {54 vars in 912 bytes} [Wed Sep 14 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:01:32.896088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:32.897540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:32.902127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e051f-ea13-4197-a9bd-692deed97a00 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:32.902499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e051f-ea13-4197-a9bd-692deed97a00 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:32.902857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e051f-ea13-4197-a9bd-692deed97a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:33.033609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ba4e051f-ea13-4197-a9bd-692deed97a00 None None] MFA Rules not processed for user `f5ca117fa96d412e9bda506591a01fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:33.035516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ba4e051f-ea13-4197-a9bd-692deed97a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:33.087193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 857/1698] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:01:33.216763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 842/1699] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:33.464583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:33.466024 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:33.503188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383c241-d360-48c3-aa6e-527f9c326546 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:33.521117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:33.521771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:33.522054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:33.522331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:33.527028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e051f-ea13-4197-a9bd-692deed97a00 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:33.544091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e051f-ea13-4197-a9bd-692deed97a00 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:33.551494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab7eb8-f4f6-4769-85ec-c5694f549a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:33.572077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7eb8-f4f6-4769-85ec-c5694f549a17 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:33.572767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7eb8-f4f6-4769-85ec-c5694f549a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:33.573298 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7eb8-f4f6-4769-85ec-c5694f549a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:33.579383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:33.579383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:33.615549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 858/1700] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:33.654688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab7eb8-f4f6-4769-85ec-c5694f549a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:33.659563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab7eb8-f4f6-4769-85ec-c5694f549a17 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:33.685457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 843/1701] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:01:34.064903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:34.066630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:34.089556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8604e3-db12-4590-9e02-6bc68b2f170f service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:34.096587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:34.097458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:34.097839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:34.098250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] PATH_INFO: `/v3/users/73e0d98556ae4d2fb9ce0e364be4b4f5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:34.099621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e0d98556ae4d2fb9ce0e364be4b4f5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:34.102002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:34.190482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e0d98556ae4d2fb9ce0e364be4b4f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.191994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e0d98556ae4d2fb9ce0e364be4b4f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.217626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e0d98556ae4d2fb9ce0e364be4b4f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.253572 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e0d98556ae4d2fb9ce0e364be4b4f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.275729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:34.295813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e0d98556ae4d2fb9ce0e364be4b4f5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.321892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 859/1702] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:34 2022] DELETE /identity/v3/users/73e0d98556ae4d2fb9ce0e364be4b4f5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:01:34.328118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:34.329505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:34.329505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:34.376568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:34.381057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:34.538415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 844/1703] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:34.577229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:34.580308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:34.610437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c6652-7c43-4a15-af23-2ff394656af8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:34.629760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:34.630473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:34.630760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:34.631032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] PATH_INFO: `/v3/projects/7e6640c93ea0406ebcb23c62526de429` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:34.632958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6640c93ea0406ebcb23c62526de429)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:34.637335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:34.655845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:34.658697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:34.694172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb4cc1-a8c0-481a-9031-c76b93eb738e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:34.715930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:34.728118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:34.732625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:34.733076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] PATH_INFO: `/v3/projects/06271b257aca447da7cab112235388e4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:34.739068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06271b257aca447da7cab112235388e4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:34.743884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: WARNING py.warnings [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 14 13:01:34.743884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: warnings.warn(msg) Sep 14 13:01:34.743884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: Sep 14 13:01:34.745281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:34.838424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6640c93ea0406ebcb23c62526de429', 'request_id': 'req-ac178a01-7f45-4fdc-986c-042660d79402'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.854279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:34.867488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6640c93ea0406ebcb23c62526de429', 'request_id': 'req-ac178a01-7f45-4fdc-986c-042660d79402'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.901260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6640c93ea0406ebcb23c62526de429', 'request_id': 'req-ac178a01-7f45-4fdc-986c-042660d79402'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.941674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] The token cache is being invalidate because project 7e6640c93ea0406ebcb23c62526de429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:34.942947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.944568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:34.951874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 860/1704] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:34 2022] DELETE /identity/v3/projects/7e6640c93ea0406ebcb23c62526de429 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:34.951874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:34.957769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:34.971419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06271b257aca447da7cab112235388e4', 'request_id': 'req-f918f2be-8481-451e-9591-2296fc20d5b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.017645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06271b257aca447da7cab112235388e4', 'request_id': 'req-f918f2be-8481-451e-9591-2296fc20d5b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.035505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06271b257aca447da7cab112235388e4', 'request_id': 'req-f918f2be-8481-451e-9591-2296fc20d5b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.073244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] The token cache is being invalidate because project 06271b257aca447da7cab112235388e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:35.073534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.078678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.082865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 845/1705] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:34 2022] DELETE /identity/v3/projects/06271b257aca447da7cab112235388e4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:35.083723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:35.087916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:35.135599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac178a01-7f45-4fdc-986c-042660d79402 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:35.256425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:35.258563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:35.259205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:35.259975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:35.267691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:35.285675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:35.287654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:35.292647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918f2be-8481-451e-9591-2296fc20d5b1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:35.321399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:35.322727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 861/1706] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:35.323655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:35.323972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:35.324830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:35.325481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] PATH_INFO: `/v3/users/6cab3c9dda8d4deba2b7720aaa5c03e8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:35.329745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:35.331815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cab3c9dda8d4deba2b7720aaa5c03e8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:35.335087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:35.366421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc0c0c-6073-4d52-8e33-77f56679e19b service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:35.399993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:35.403387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:35.405737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:35.408366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] PATH_INFO: `/v3/users/09817b138f6d49d9992930e460a80fd5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:35.414086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09817b138f6d49d9992930e460a80fd5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:35.420923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:35.449028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cab3c9dda8d4deba2b7720aaa5c03e8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.451925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cab3c9dda8d4deba2b7720aaa5c03e8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.452755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cab3c9dda8d4deba2b7720aaa5c03e8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.473178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cab3c9dda8d4deba2b7720aaa5c03e8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.501625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:35.510544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cab3c9dda8d4deba2b7720aaa5c03e8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.541796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 846/1707] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:35 2022] DELETE /identity/v3/users/6cab3c9dda8d4deba2b7720aaa5c03e8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:35.564675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09817b138f6d49d9992930e460a80fd5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.566657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09817b138f6d49d9992930e460a80fd5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.568288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09817b138f6d49d9992930e460a80fd5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.592407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09817b138f6d49d9992930e460a80fd5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.627148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2afc191e-30ed-45a2-877c-f9bc87380f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09817b138f6d49d9992930e460a80fd5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:35.659803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 862/1708] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:35 2022] DELETE /identity/v3/users/09817b138f6d49d9992930e460a80fd5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:35.933132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:35.935031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:36.004280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:36.057837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:36.060372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:36.060372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:36.109296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] MFA Rules not processed for user `df16e3ecae574db7a79d7a1d5b825336`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:36.114889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc5943-aec1-4eef-8e9a-0eef661b03b3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:36.116464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:36.289435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 863/1709] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:36.315573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:36.316376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:36.316686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:36.317573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:36.325137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:36.351079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:36.354406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:36.384527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 847/1710] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:36.585035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:36.587324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:36.736159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:36.741172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:36.868560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e892deb-064b-47ba-b3ea-a67a57b2d3ce None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:36.884075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:36.884753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:36.885039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:36.885360 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] PATH_INFO: `/v3/projects/ed76e8aebbe64240b9acfd18ecb8e9a7` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:36.890470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed76e8aebbe64240b9acfd18ecb8e9a7)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:36.893343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:37.031459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f139f9-0d46-45eb-aaeb-6397fa93b572 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:37.044422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:37.051349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed76e8aebbe64240b9acfd18ecb8e9a7', 'request_id': 'req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.070631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed76e8aebbe64240b9acfd18ecb8e9a7', 'request_id': 'req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.091280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed76e8aebbe64240b9acfd18ecb8e9a7', 'request_id': 'req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.120208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] The token cache is being invalidate because project ed76e8aebbe64240b9acfd18ecb8e9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:37.120846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.123859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.129510 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 864/1711] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:36 2022] DELETE /identity/v3/projects/ed76e8aebbe64240b9acfd18ecb8e9a7 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:37.130687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:37.134413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:37.222313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:37.223176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:37.223459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:37.223733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] PATH_INFO: `/v3/projects/d5bb473e22004be39164fd13e822f02b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:37.234625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5bb473e22004be39164fd13e822f02b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:37.239993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:37.271390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:37.351245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64a669-e6e1-47cd-b15d-820b85b4f2c6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:37.378026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5bb473e22004be39164fd13e822f02b', 'request_id': 'req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.395007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5bb473e22004be39164fd13e822f02b', 'request_id': 'req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.420297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5bb473e22004be39164fd13e822f02b', 'request_id': 'req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.452630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] The token cache is being invalidate because project d5bb473e22004be39164fd13e822f02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:37.452630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.462846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.462846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 848/1712] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:36 2022] DELETE /identity/v3/projects/d5bb473e22004be39164fd13e822f02b => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:37.462846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:37.462846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:37.555832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:37.556805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:37.558018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:37.559236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] PATH_INFO: `/v3/projects/11383ed41e90401aa50d22e1893a36a7` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:37.561345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=11383ed41e90401aa50d22e1893a36a7)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:37.564900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:37.622695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cade68f-dfb8-4ed8-bf7d-b90501f8d8b2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:37.638369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:37.640362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:37.641626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:37.642547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] PATH_INFO: `/v3/projects/f0727184773a4afaa4c38ddad9e242b1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:37.644331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0727184773a4afaa4c38ddad9e242b1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:37.663014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:37.693531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11383ed41e90401aa50d22e1893a36a7', 'request_id': 'req-6178b04d-eabe-454d-b9fc-089a46a6f15f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.712567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11383ed41e90401aa50d22e1893a36a7', 'request_id': 'req-6178b04d-eabe-454d-b9fc-089a46a6f15f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.737662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11383ed41e90401aa50d22e1893a36a7', 'request_id': 'req-6178b04d-eabe-454d-b9fc-089a46a6f15f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.758994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] The token cache is being invalidate because project 11383ed41e90401aa50d22e1893a36a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:37.760396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.760603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6178b04d-eabe-454d-b9fc-089a46a6f15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.767624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 865/1713] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:37 2022] DELETE /identity/v3/projects/11383ed41e90401aa50d22e1893a36a7 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:37.771844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f67696-387b-4268-961a-2f7fb4c0d839 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:37.772297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f67696-387b-4268-961a-2f7fb4c0d839 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:37.772778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f67696-387b-4268-961a-2f7fb4c0d839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:37.803569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-23f67696-387b-4268-961a-2f7fb4c0d839 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:37.805190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-23f67696-387b-4268-961a-2f7fb4c0d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:37.811539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:37.835266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0727184773a4afaa4c38ddad9e242b1', 'request_id': 'req-373e85aa-478a-4632-aac7-716bf58e0ad8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.853339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0727184773a4afaa4c38ddad9e242b1', 'request_id': 'req-373e85aa-478a-4632-aac7-716bf58e0ad8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.871588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0727184773a4afaa4c38ddad9e242b1', 'request_id': 'req-373e85aa-478a-4632-aac7-716bf58e0ad8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.888334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] The token cache is being invalidate because project f0727184773a4afaa4c38ddad9e242b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:37.888786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.890343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:37.892602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 849/1714] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:37 2022] DELETE /identity/v3/projects/f0727184773a4afaa4c38ddad9e242b1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:37.893970 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:37.895932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:37.992664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 866/1715] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:37.999211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a16f-716a-4e24-9610-0ba9032fd8e1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:37.999211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a16f-716a-4e24-9610-0ba9032fd8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:37.999211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a16f-716a-4e24-9610-0ba9032fd8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.009700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:38.064043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8761a16f-716a-4e24-9610-0ba9032fd8e1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:38.064043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8761a16f-716a-4e24-9610-0ba9032fd8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:38.084752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 867/1716] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:38.088795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6a02-8d3f-43db-9c33-ec78e6d149e0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.092268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6a02-8d3f-43db-9c33-ec78e6d149e0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.092701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6a02-8d3f-43db-9c33-ec78e6d149e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.107191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e85aa-478a-4632-aac7-716bf58e0ad8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:38.116918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:38.118218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.118509 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.118810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] PATH_INFO: `/v3/users/f5f01db469f34cafa5cf3195068c5dfe` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.120181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f01db469f34cafa5cf3195068c5dfe)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:38.122116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:38.128787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a06a6a02-8d3f-43db-9c33-ec78e6d149e0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:38.130301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a06a6a02-8d3f-43db-9c33-ec78e6d149e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:38.160000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 868/1717] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:38.160000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd06c-8208-4873-be33-94cf07db4c5f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.160000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd06c-8208-4873-be33-94cf07db4c5f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.160000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd06c-8208-4873-be33-94cf07db4c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.203919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-286cd06c-8208-4873-be33-94cf07db4c5f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:38.206171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-286cd06c-8208-4873-be33-94cf07db4c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:38.224517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 869/1718] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:38.232443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a614f-9bfe-4b27-bafb-3e9c6157c843 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.232739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a614f-9bfe-4b27-bafb-3e9c6157c843 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.233148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a614f-9bfe-4b27-bafb-3e9c6157c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.249080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f01db469f34cafa5cf3195068c5dfe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:38.250597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f01db469f34cafa5cf3195068c5dfe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:38.251794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f01db469f34cafa5cf3195068c5dfe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:38.273362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f01db469f34cafa5cf3195068c5dfe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:38.283390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-934a614f-9bfe-4b27-bafb-3e9c6157c843 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:38.284671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-934a614f-9bfe-4b27-bafb-3e9c6157c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:38.309783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 870/1719] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:38.311210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71ab5-070e-400b-ad5e-104d18920d6c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.311645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71ab5-070e-400b-ad5e-104d18920d6c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.311929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d71ab5-070e-400b-ad5e-104d18920d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.342443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f01db469f34cafa5cf3195068c5dfe'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:38.365446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-10d71ab5-070e-400b-ad5e-104d18920d6c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:38.366700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10d71ab5-070e-400b-ad5e-104d18920d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:38.371328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 850/1720] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:37 2022] DELETE /identity/v3/users/f5f01db469f34cafa5cf3195068c5dfe => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:38.385680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:38.387273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:38.406054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 871/1721] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:38.407821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d71ab5-070e-400b-ad5e-104d18920d6c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:38.446560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d71ab5-070e-400b-ad5e-104d18920d6c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:38.644179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf706f-a5c8-4109-89de-bf62887ccbce admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:38.658611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:38.659552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.659990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.660459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.662617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:38.663073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:38.665021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:38.672928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:38.673562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.673841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.674123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.674892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:38.675197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:38.676900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:38.698384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 851/1722] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:38.701000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:38.715601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c771f7-7e13-4cb1-b402-f1ec1ac8233c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:38.721481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 872/1723] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:38.727073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:38.728046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:38.728829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.729210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.729582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.730342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:38.731208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:38.733372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:38.758117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac4d9c-c068-4f01-b508-703fc1693f9c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:38.766916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 852/1724] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:38.769567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:38.776858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:38.777498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.777835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.778048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.778964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:38.796641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d2d49-929e-4944-820d-ad6fe705217a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:38.798463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:38.820125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:38.820893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:38.821293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:38.821658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:38.823671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:38.827922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:38.858487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 873/1725] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:38.863477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:38.906864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 853/1726] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:38.908129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:38.970093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:39.015005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:39.043205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3b81-83ed-4498-a28b-ba76ec748220 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.104442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade3385-9627-4a3f-8bc9-4f0d6b256159 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.115079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.115888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.116210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.116489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.117152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.121667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.161367 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 854/1727] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:39.162513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.185256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051b1a1-8ff3-4466-ab26-2324a3c224e4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.191147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.191883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.192718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.193843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.195316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.195933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.196618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.196889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.197170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.197813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.198904 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.199750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.245829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 855/1728] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:39 2022] POST /identity/v3/users => generated 283 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:39.246712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.256998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 874/1729] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:38 2022] POST /identity/v3/projects => generated 387 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:39.258167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.276324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1d61e-3e09-4297-84cd-7ce12abbc83e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.448634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e777d35-7f5a-48e0-baee-2fc1b2dbe75a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.464835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.466013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.466301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.466579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.467479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.469272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.480358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.480932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.481180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.481446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.482210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.484176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.493319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 875/1730] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:39.494320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.517437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 856/1731] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:39.518307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.523213 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4c253-85f4-4c24-856e-84d6a155e036 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.542631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.543248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.543540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.543862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.544538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.546465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.552048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0a62-a104-4d18-945c-32365c5b8582 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.575197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.575792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.576118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.576418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.577047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.579668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.609119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 876/1732] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:39 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:39.610513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.625530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f64b0-4a40-43cb-81e7-388808cf55b5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.633169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.636608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.637027 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.637328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.639877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.644133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 857/1733] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:39.644133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.658301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.694843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d09a-2839-409d-b0f1-79d5fdc84f9e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.701743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 877/1734] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:39.705547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.724380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.725395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.725915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.726510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.727648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.733078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dae51-4e51-41c2-8d4f-9ce9aad95aa6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.735285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.748634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e9ce5-020d-4139-a162-34b9fd0b32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.749536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e9ce5-020d-4139-a162-34b9fd0b32ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.749814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e9ce5-020d-4139-a162-34b9fd0b32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.750707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e9ce5-020d-4139-a162-34b9fd0b32ed admin admin] PATH_INFO: `/v3/projects/0fc9ee8a9bf643199b166313dd8168e7/users/339cec01fc014cfb921540acd111fdc6/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.781059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 858/1735] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:39.793007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e9ce5-020d-4139-a162-34b9fd0b32ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc9ee8a9bf643199b166313dd8168e7, user_id=339cec01fc014cfb921540acd111fdc6, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.795527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:39.796382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3e9ce5-020d-4139-a162-34b9fd0b32ed admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:39.799648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:39.832674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cab6d-4919-4713-8675-43c7954feb24 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:39.853613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 878/1736] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:39 2022] PUT /identity/v3/projects/0fc9ee8a9bf643199b166313dd8168e7/users/339cec01fc014cfb921540acd111fdc6/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:39.856672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563503-a194-40b9-b0fe-105eb6843609 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.856962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563503-a194-40b9-b0fe-105eb6843609 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.859718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b563503-a194-40b9-b0fe-105eb6843609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.967928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1b563503-a194-40b9-b0fe-105eb6843609 None None] MFA Rules not processed for user `35facb0f8769456d86fc13db4be34dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:39.969873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:39.970792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1b563503-a194-40b9-b0fe-105eb6843609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:39.989413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:39.990650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:39.990934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:39.991212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] PATH_INFO: `/v3/projects/6f2aa2eb4c2f428085a11a0106e7cc38` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:39.992487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2aa2eb4c2f428085a11a0106e7cc38)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:39.996474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:40.025695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:40.105498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2aa2eb4c2f428085a11a0106e7cc38', 'request_id': 'req-6553642b-93cb-471a-b85c-166ac7344936'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:40.115606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2aa2eb4c2f428085a11a0106e7cc38', 'request_id': 'req-6553642b-93cb-471a-b85c-166ac7344936'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:40.130315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2aa2eb4c2f428085a11a0106e7cc38', 'request_id': 'req-6553642b-93cb-471a-b85c-166ac7344936'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:40.168295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] The token cache is being invalidate because project 6f2aa2eb4c2f428085a11a0106e7cc38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:40.168651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:40.169585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:40.175325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 859/1737] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:39 2022] DELETE /identity/v3/projects/6f2aa2eb4c2f428085a11a0106e7cc38 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:40.175966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:40.181380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:40.339558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 879/1738] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:40.359586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91cf1-27c9-40db-93a8-d750ff8a0b08 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:40.360334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91cf1-27c9-40db-93a8-d750ff8a0b08 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:40.360787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa91cf1-27c9-40db-93a8-d750ff8a0b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:40.428638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dfa91cf1-27c9-40db-93a8-d750ff8a0b08 None None] MFA Rules not processed for user `33ba92af52134e7aadd45d4503bb0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:40.430770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dfa91cf1-27c9-40db-93a8-d750ff8a0b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:40.481565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553642b-93cb-471a-b85c-166ac7344936 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:40.503446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:40.504570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:40.505027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:40.505484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] PATH_INFO: `/v3/projects/ec975d8c1db54365b1945d89faee7ccd/users/647a9ee6a066455b8033b50edb43974a/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:40.580342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec975d8c1db54365b1945d89faee7ccd, user_id=647a9ee6a066455b8033b50edb43974a, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:40.586315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:40.647767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 860/1739] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:40 2022] PUT /identity/v3/projects/ec975d8c1db54365b1945d89faee7ccd/users/647a9ee6a066455b8033b50edb43974a/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:40.659093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:40.659093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:40.666831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 880/1740] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:40.668479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716bd55-cb0a-454d-91fc-8e5aa050e41b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:40.668868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716bd55-cb0a-454d-91fc-8e5aa050e41b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:40.669241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716bd55-cb0a-454d-91fc-8e5aa050e41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:40.741782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9716bd55-cb0a-454d-91fc-8e5aa050e41b None None] MFA Rules not processed for user `339cec01fc014cfb921540acd111fdc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:40.743810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9716bd55-cb0a-454d-91fc-8e5aa050e41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:40.860930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6922f0e-1a91-4ceb-8646-af6783ace3a6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:40.869917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:40.870491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:40.870856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:40.871401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:40.872169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:40.874339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:40.894775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 861/1741] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:40.896201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:40.900832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:40.918859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:40.935584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2743a2-f4b3-43d7-ba3f-fc3966857c90 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:40.947949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:40.950248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:40.952475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:40.952870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] PATH_INFO: `/v3/users/f685497b991d4648a0d9157865bfb6b6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:40.957334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f685497b991d4648a0d9157865bfb6b6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:40.958709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 881/1742] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:40.960252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4c48-e3ff-4e6d-8b48-a0c4d98cae93 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:40.960539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4c48-e3ff-4e6d-8b48-a0c4d98cae93 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:40.960812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4c48-e3ff-4e6d-8b48-a0c4d98cae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:40.966787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:41.090673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f685497b991d4648a0d9157865bfb6b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:41.091637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f685497b991d4648a0d9157865bfb6b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:41.098978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f685497b991d4648a0d9157865bfb6b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:41.118630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f685497b991d4648a0d9157865bfb6b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:41.154549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f685497b991d4648a0d9157865bfb6b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:41.181077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-185b4c48-e3ff-4e6d-8b48-a0c4d98cae93 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:41.182294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-185b4c48-e3ff-4e6d-8b48-a0c4d98cae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:41.185050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 862/1743] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:40 2022] DELETE /identity/v3/users/f685497b991d4648a0d9157865bfb6b6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:41.186416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:41.201955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:41.247950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:41.378311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 882/1744] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:41.379797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:41.380172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:41.380675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:41.457499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ed9e-30aa-47b6-a18f-6be8ad8bf77c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:41.470086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:41.470881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:41.471376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:41.471517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] MFA Rules not processed for user `647a9ee6a066455b8033b50edb43974a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:41.471852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:41.472815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:41.481551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:41.689633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:41.691169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:41.712870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 863/1745] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:41.713755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:41.720106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:41.723650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 883/1746] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:41.724697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:41.726127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:41.748888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:41.931773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77598-c59c-4e99-8cd0-9365950c3c92 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:41.942901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:41.943582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:41.943865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:41.944168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:41.944866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:41.945263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea934-6024-486d-8f21-a237092aa5c5 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:41.949168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:41.953013 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:41.970623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:41.972355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:41.972659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] PATH_INFO: `/v3/projects/94e828338d744000a42b6f1c0b10b862/users/86310f3c72a743f19edddf7938821674/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:42.020127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 884/1747] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:41 2022] POST /identity/v3/projects => generated 365 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:42.021395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:42.038713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e828338d744000a42b6f1c0b10b862, user_id=86310f3c72a743f19edddf7938821674, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:42.041815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:42.051536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:42.108359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 864/1748] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:41 2022] PUT /identity/v3/projects/94e828338d744000a42b6f1c0b10b862/users/86310f3c72a743f19edddf7938821674/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:42.109585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:42.122027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:42.205610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:42.268416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54117e1-c8c5-4bdb-9d1a-b4c4a2a6d400 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:42.437234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda8504-8db1-4443-9e3b-768719ba4e3d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:42.455155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302823-2085-425e-9f23-6dd26f040d8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:42.455830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302823-2085-425e-9f23-6dd26f040d8f service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:42.456117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302823-2085-425e-9f23-6dd26f040d8f service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:42.456397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302823-2085-425e-9f23-6dd26f040d8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:42.470570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:42.472932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:42.473440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:42.474154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:42.475631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:42.482469 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:42.564275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 885/1749] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:42 2022] POST /identity/v3/projects => generated 373 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:42.565384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:42.661497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302823-2085-425e-9f23-6dd26f040d8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:42.663138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302823-2085-425e-9f23-6dd26f040d8f service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:42.698825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 865/1750] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:01:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:01:42.699966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88324357-b535-42e7-a76b-0a31cc82cc9a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:42.700285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88324357-b535-42e7-a76b-0a31cc82cc9a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:42.701942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bd747-5b70-4464-82e1-bc6e8525cba9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:42.708055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:42.708390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88324357-b535-42e7-a76b-0a31cc82cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:42.708718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:42.708997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:42.709269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:42.710339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:42.712044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:42.842004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-88324357-b535-42e7-a76b-0a31cc82cc9a None None] MFA Rules not processed for user `86310f3c72a743f19edddf7938821674`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:42.843362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-88324357-b535-42e7-a76b-0a31cc82cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:42.863825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 886/1751] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:42 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:42.864770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:42.868950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:42.918961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfb7a-3504-45f9-afb5-234cf6f0b5ac admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:42.953502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:42.954337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:42.954774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:42.955196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:42.956218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:42.965499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:43.057206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 887/1752] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:42 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:43.057901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:43.107695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416fd1ca-a3c5-4e6a-a968-332a767d13f4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:43.135411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:43.136075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:43.136362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:43.136636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:43.137298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:43.138918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:43.218950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 866/1753] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:43.226479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 888/1754] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:43.227502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:43.230150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88324357-b535-42e7-a76b-0a31cc82cc9a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:43.278595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88324357-b535-42e7-a76b-0a31cc82cc9a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:43.290526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc26d4-6862-4489-9c58-287e59b42677 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:43.307713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:43.307713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:43.308127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:43.308391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:43.309833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:43.311120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:43.334972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:43.335733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:43.337228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:43.337608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:43.343576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:43.346113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:43.368914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 867/1755] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:43.386410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:43.441220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e24b6-688b-4ff5-8d48-a1c1e826400f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:43.464872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:43.465463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:43.465771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:43.466019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] PATH_INFO: `/v3/projects/7d5bccc77a714b3b8bfd8a808427ecbb/users/e8e5273c3c1a4756994141905455ca9c/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:43.476660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 889/1756] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:43 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:43.485556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:43.532446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:43.550493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5bccc77a714b3b8bfd8a808427ecbb, user_id=e8e5273c3c1a4756994141905455ca9c, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:43.553328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:43.635080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 868/1757] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:43 2022] PUT /identity/v3/projects/7d5bccc77a714b3b8bfd8a808427ecbb/users/e8e5273c3c1a4756994141905455ca9c/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:43.636190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:43.645757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:43.782109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da46f8f-ae23-487d-b30a-62be4810e33e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:43.907983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694c4e5-d8f8-4c81-8252-20c7184a6f7d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:43.917530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:43.918563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:43.919080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:43.919554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] PATH_INFO: `/v3/projects/37f5cb7b2c684b39a7d2abdbcf8f7c9f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:43.921018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f5cb7b2c684b39a7d2abdbcf8f7c9f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:43.926985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.044531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:44.045279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.045557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.050220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] PATH_INFO: `/v3/projects/4780ae2d003740eab2796c1fc3d31e48/users/02d1f97d119f43e59be12564dbaf200f/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.111786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f5cb7b2c684b39a7d2abdbcf8f7c9f', 'request_id': 'req-c61a7b33-80a2-4888-84be-46d558c2bb95'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:44.122673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f5cb7b2c684b39a7d2abdbcf8f7c9f', 'request_id': 'req-c61a7b33-80a2-4888-84be-46d558c2bb95'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:44.137616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f5cb7b2c684b39a7d2abdbcf8f7c9f', 'request_id': 'req-c61a7b33-80a2-4888-84be-46d558c2bb95'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:44.147943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4780ae2d003740eab2796c1fc3d31e48, user_id=02d1f97d119f43e59be12564dbaf200f, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:44.154012 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.195036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:44.247633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 890/1758] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:43 2022] PUT /identity/v3/projects/4780ae2d003740eab2796c1fc3d31e48/users/02d1f97d119f43e59be12564dbaf200f/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:44.253278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:44.255534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] The token cache is being invalidate because project 37f5cb7b2c684b39a7d2abdbcf8f7c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:44.261851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:44.269748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:44.281540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 869/1759] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:43 2022] DELETE /identity/v3/projects/37f5cb7b2c684b39a7d2abdbcf8f7c9f => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:44.283851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:44.292839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:44.444467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27feb9f-181f-476d-8fc4-697f15d84c5a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:44.453007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e7dd6-1428-44d1-b973-1f4753077869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:44.454730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7dd6-1428-44d1-b973-1f4753077869 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.455237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7dd6-1428-44d1-b973-1f4753077869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.455772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e7dd6-1428-44d1-b973-1f4753077869 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.456715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e7dd6-1428-44d1-b973-1f4753077869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:44.460565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e7dd6-1428-44d1-b973-1f4753077869 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.491489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 891/1760] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:44 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:44.493776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a88a-d819-4fe2-95ea-6d5025264dc8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.494422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a88a-d819-4fe2-95ea-6d5025264dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.494877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392a88a-d819-4fe2-95ea-6d5025264dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.527190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4392a88a-d819-4fe2-95ea-6d5025264dc8 None None] MFA Rules not processed for user `f5ca117fa96d412e9bda506591a01fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:44.529918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4392a88a-d819-4fe2-95ea-6d5025264dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:44.594854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a7b33-80a2-4888-84be-46d558c2bb95 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:44.616615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:44.617402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.621848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.623272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.626324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:44.630184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.648570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:44.681030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 870/1761] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:44.682325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:44.684626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:44.718769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493783c-2460-4a68-af2a-11fb8474c60d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:44.735505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:44.736496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.736908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.737284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.738178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:44.740335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.747829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 892/1762] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Sep 14 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:44.754244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5437-8c46-425e-8ae6-d24a3ebc93a3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.754585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5437-8c46-425e-8ae6-d24a3ebc93a3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.756305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c5437-8c46-425e-8ae6-d24a3ebc93a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.768431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 871/1763] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:44.774864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:44.780092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:44.827485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb8425-6e07-4d4d-bc88-3a21cfccfcce admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:44.834115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:44.835506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.835506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.835506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.836563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:44.838881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.839613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e30c5437-8c46-425e-8ae6-d24a3ebc93a3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:44.841159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e30c5437-8c46-425e-8ae6-d24a3ebc93a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:44.863572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 872/1764] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:44.865097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:44.872664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 893/1765] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:44.873989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5437-8c46-425e-8ae6-d24a3ebc93a3 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:44.890014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755f12f-6a8d-4eb9-972b-032425e022d7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:44.903912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c5437-8c46-425e-8ae6-d24a3ebc93a3 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:44.909566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:44.910753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.911144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.911565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] PATH_INFO: `/v3/projects/7d5bccc77a714b3b8bfd8a808427ecbb/users/e8e5273c3c1a4756994141905455ca9c/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.915158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:44.915883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:44.916246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:44.916526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] PATH_INFO: `/v3/projects/4780ae2d003740eab2796c1fc3d31e48/users/02d1f97d119f43e59be12564dbaf200f/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:44.919350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4780ae2d003740eab2796c1fc3d31e48, user_id=02d1f97d119f43e59be12564dbaf200f, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:44.923225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.929971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d5bccc77a714b3b8bfd8a808427ecbb, user_id=e8e5273c3c1a4756994141905455ca9c, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:44.934745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:44.940882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 894/1766] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:44 2022] PUT /identity/v3/projects/4780ae2d003740eab2796c1fc3d31e48/users/02d1f97d119f43e59be12564dbaf200f/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:44.942678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:44.956140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:44.997869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 873/1767] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:44 2022] PUT /identity/v3/projects/7d5bccc77a714b3b8bfd8a808427ecbb/users/e8e5273c3c1a4756994141905455ca9c/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:44.999124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:45.221699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf02f-25ef-4128-840c-192a8c40961a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:45.245935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c133760-a3a0-4f26-8447-c6f78df53518 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:45.260249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d333d4-0d8a-4616-9b54-fc35f96b2b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:45.261059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d333d4-0d8a-4616-9b54-fc35f96b2b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:45.261451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d333d4-0d8a-4616-9b54-fc35f96b2b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:45.261849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d333d4-0d8a-4616-9b54-fc35f96b2b7b admin admin] PATH_INFO: `/v3/projects/a61d54ca3fdb458d9eec98edb58308fe/users/6859829b29ba491cbe0203aede5f39ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:45.315023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d333d4-0d8a-4616-9b54-fc35f96b2b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61d54ca3fdb458d9eec98edb58308fe, user_id=6859829b29ba491cbe0203aede5f39ad, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:45.322333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d333d4-0d8a-4616-9b54-fc35f96b2b7b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:45.373760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 874/1768] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:44 2022] PUT /identity/v3/projects/a61d54ca3fdb458d9eec98edb58308fe/users/6859829b29ba491cbe0203aede5f39ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:45.375818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820734f8-3092-44c3-9e3b-8eb99b900ef3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:45.380548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820734f8-3092-44c3-9e3b-8eb99b900ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:45.381077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820734f8-3092-44c3-9e3b-8eb99b900ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:45.436304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b87c6-a1d8-4699-a005-067250de6b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:45.436789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b87c6-a1d8-4699-a005-067250de6b4d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:45.437074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b87c6-a1d8-4699-a005-067250de6b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:45.438098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b87c6-a1d8-4699-a005-067250de6b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:45.443509 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-820734f8-3092-44c3-9e3b-8eb99b900ef3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:45.445635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-820734f8-3092-44c3-9e3b-8eb99b900ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:45.472835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b87c6-a1d8-4699-a005-067250de6b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:45.473116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b87c6-a1d8-4699-a005-067250de6b4d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:45.504534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 895/1769] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:45.513521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b43b22-25d9-46aa-bd6d-84d498b90108 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:45.513521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b43b22-25d9-46aa-bd6d-84d498b90108 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:45.513521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b43b22-25d9-46aa-bd6d-84d498b90108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:45.572490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a5b43b22-25d9-46aa-bd6d-84d498b90108 None None] MFA Rules not processed for user `02d1f97d119f43e59be12564dbaf200f`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:45.574026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5b43b22-25d9-46aa-bd6d-84d498b90108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:45.645315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:45.792216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 875/1770] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:45.792216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba6cc-2c4e-4b30-b57c-05e6e47b18b7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:45.792216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba6cc-2c4e-4b30-b57c-05e6e47b18b7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:45.792216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ba6cc-2c4e-4b30-b57c-05e6e47b18b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:45.889109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 896/1771] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:45.890796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b43b22-25d9-46aa-bd6d-84d498b90108 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:45.902911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:45.923810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b43b22-25d9-46aa-bd6d-84d498b90108 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:45.926113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-284ba6cc-2c4e-4b30-b57c-05e6e47b18b7 None None] MFA Rules not processed for user `e8e5273c3c1a4756994141905455ca9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:45.928874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-284ba6cc-2c4e-4b30-b57c-05e6e47b18b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:45.939109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:45.940801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:45.943387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:45.943891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:45.944787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:45.963215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:45.992656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 897/1772] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:45.994441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:46.024392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6ad1a-110a-439b-beb1-bdf9b7f44332 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:46.043291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:46.045201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:46.045735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:46.046211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:46.050094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:46.051860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:46.057502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:46.101450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 898/1773] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:46.103000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:46.110098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:46.248423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 876/1774] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:46.250627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ba6cc-2c4e-4b30-b57c-05e6e47b18b7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:46.303328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ba6cc-2c4e-4b30-b57c-05e6e47b18b7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:46.309053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef80813-2006-49c9-aefc-e9ad5f8e22c6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:46.315148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:46.322983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:46.323356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:46.323646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] PATH_INFO: `/v3/projects/a61d54ca3fdb458d9eec98edb58308fe/users/6859829b29ba491cbe0203aede5f39ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:46.329253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591391fb-bc72-4840-b483-577c216561af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:46.329989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591391fb-bc72-4840-b483-577c216561af service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:46.330313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591391fb-bc72-4840-b483-577c216561af service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:46.330591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591391fb-bc72-4840-b483-577c216561af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:46.332797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a61d54ca3fdb458d9eec98edb58308fe, user_id=6859829b29ba491cbe0203aede5f39ad, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:46.338100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:46.362287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591391fb-bc72-4840-b483-577c216561af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:46.373762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591391fb-bc72-4840-b483-577c216561af service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:46.382659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 877/1775] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:46 2022] PUT /identity/v3/projects/a61d54ca3fdb458d9eec98edb58308fe/users/6859829b29ba491cbe0203aede5f39ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:46.383282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:46.450763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 899/1776] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:46.451467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591391fb-bc72-4840-b483-577c216561af service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:46.467295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-591391fb-bc72-4840-b483-577c216561af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:46.527786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591391fb-bc72-4840-b483-577c216561af service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:46.649073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14693c5b-ea74-4dc7-9569-965b28a8f8ae admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:46.685688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ec05a-50d9-4472-9122-86be79a04b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:46.686933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ec05a-50d9-4472-9122-86be79a04b5e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:46.687483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ec05a-50d9-4472-9122-86be79a04b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:46.687872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ec05a-50d9-4472-9122-86be79a04b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:46.697677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ec05a-50d9-4472-9122-86be79a04b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:46.705768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ec05a-50d9-4472-9122-86be79a04b5e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:46.709138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:46.710003 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:46.710445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:46.710869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:46.853044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 878/1777] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:46 2022] POST /identity/v3/projects => generated 393 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:46.856140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d0f2b-18fc-48d2-923f-89c5b0a08b67 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:46.857029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d0f2b-18fc-48d2-923f-89c5b0a08b67 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:46.858094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d0f2b-18fc-48d2-923f-89c5b0a08b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:46.969245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5e3d0f2b-18fc-48d2-923f-89c5b0a08b67 None None] MFA Rules not processed for user `6859829b29ba491cbe0203aede5f39ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:46.970512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:46.972985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5e3d0f2b-18fc-48d2-923f-89c5b0a08b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:46.974398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:47.020765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 900/1778] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:47.021764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:47.077826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafddde-54e2-4a75-8a71-fa7912c8beff service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:47.149351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:47.264434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:47.366445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 879/1779] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:47.367309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:47.367987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:47.368288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:47.368566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:47.373009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d0f2b-18fc-48d2-923f-89c5b0a08b67 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:47.381966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:47.571282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:47.575854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:47.584847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d0f2b-18fc-48d2-923f-89c5b0a08b67 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:47.600499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:47.601306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:47.601679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:47.602091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:47.602888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:47.610777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 901/1780] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:47.612494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:47.615707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:47.649934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ee3ed-879c-4ea9-ac6f-2b9388d611d7 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:47.655852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 880/1781] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:47 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:47.661687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:47.674242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:47.675035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:47.675298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:47.680786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:47.682076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfac55-bccc-47f5-9ae1-dac7cec350ac admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:47.685901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:47.699839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:47.700515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:47.700796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:47.701068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:47.701831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:47.704654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:47.737425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 881/1782] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:01:47.742176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:47.762750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39449f-660b-4e8a-9264-c49681974ae8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:47.805085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:47.805756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:47.811617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:47.811961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:47.816087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:47.823811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:47.873118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 882/1783] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:47.876119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:47.913751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:47.915328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904cd4-8b89-40af-ba9b-40ea0b7c762a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:47.929085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:47.943535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5975d-dd69-48a9-becc-cadd465a7a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:47.944514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5975d-dd69-48a9-becc-cadd465a7a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:47.944801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5975d-dd69-48a9-becc-cadd465a7a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:47.945167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5975d-dd69-48a9-becc-cadd465a7a52 admin admin] PATH_INFO: `/v3/projects/13069d2e75e643aba379cf5a914ac387/users/a4e1e0e6961549c09fbfe642d27bb48a/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:47.968154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 902/1784] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:47.969869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:47.979677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5975d-dd69-48a9-becc-cadd465a7a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13069d2e75e643aba379cf5a914ac387, user_id=a4e1e0e6961549c09fbfe642d27bb48a, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:47.998297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5975d-dd69-48a9-becc-cadd465a7a52 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:48.016974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361a7b-36e7-48af-908a-8bff88a0ec19 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:48.034398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:48.036940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:48.037234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:48.037503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:48.060533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 883/1785] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:47 2022] PUT /identity/v3/projects/13069d2e75e643aba379cf5a914ac387/users/a4e1e0e6961549c09fbfe642d27bb48a/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:48.063337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7defaa-3f4e-408b-87e5-32adea24f214 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:48.063337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7defaa-3f4e-408b-87e5-32adea24f214 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:48.063337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7defaa-3f4e-408b-87e5-32adea24f214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:48.094110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:48.098322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:48.158318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 903/1786] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:48.203439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ba7defaa-3f4e-408b-87e5-32adea24f214 None None] MFA Rules not processed for user `a4e1e0e6961549c09fbfe642d27bb48a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:48.205048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ba7defaa-3f4e-408b-87e5-32adea24f214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:48.217163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:48.237395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06478-a8cb-42b5-91fa-673a72a91a9c service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:48.553948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:48.574333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 884/1787] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 513 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:48.580904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7defaa-3f4e-408b-87e5-32adea24f214 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:48.581688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:48.583597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:48.583934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:48.585815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] PATH_INFO: `/v3/users/86310f3c72a743f19edddf7938821674` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:48.589040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86310f3c72a743f19edddf7938821674)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:48.622542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:48.635227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7defaa-3f4e-408b-87e5-32adea24f214 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:48.675991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:48.676918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:48.678141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:48.680690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:48.681248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:48.681798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:48.684063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:48.782894 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 885/1788] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:48 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:48.783700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86310f3c72a743f19edddf7938821674'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:48.784780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86310f3c72a743f19edddf7938821674'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:48.785647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86310f3c72a743f19edddf7938821674'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:48.788671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:48.793080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:48.829114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86310f3c72a743f19edddf7938821674'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:48.898331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b04c9f14-5488-470a-939a-6db6e6f7a5e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86310f3c72a743f19edddf7938821674'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:48.929500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 904/1789] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:48 2022] DELETE /identity/v3/users/86310f3c72a743f19edddf7938821674 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:01:48.931314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:48.931883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:48.932614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:48.992819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:48.996568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:49.120161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e86a-dd79-4ccb-a018-256b0488e3ae admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:49.334499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 905/1790] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:49.339288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:49.339941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:49.340435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:49.340887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:49.341920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:49.358033 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:49.417156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:49.419310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:49.470861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 886/1791] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:48 2022] POST /identity/v3/users => generated 301 bytes in 676 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:01:49.472547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:49.524846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e49305-7e07-47e4-989f-27800903ee6b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:49.543751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:49.544892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:49.545206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:49.545907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:49.547383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:49.550251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:49.612497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 887/1792] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:49.613960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:49.634477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55309f62-d7c8-4b5d-b579-5c6b4d1d502f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:49.645276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cc6a-184b-4cfe-8ac2-ac47e66f611d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:49.646320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:49.647596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:49.648419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:49.649334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:49.668789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:49.672563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:49.682099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:49.683274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:49.683791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:49.684313 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] PATH_INFO: `/v3/projects/19659b5c63ed4d648bd84fba70420395/users/7fd43ffc2a3243688bdd368d7fc54de9/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:49.699914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 906/1793] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:01:49.790020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19659b5c63ed4d648bd84fba70420395, user_id=7fd43ffc2a3243688bdd368d7fc54de9, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:49.799428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:49.865155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 888/1794] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:49 2022] PUT /identity/v3/projects/19659b5c63ed4d648bd84fba70420395/users/7fd43ffc2a3243688bdd368d7fc54de9/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:49.872221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:49.911854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58fd88-2b4d-484b-ab11-9bb06a47e84f service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:50.017755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:50.115892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca3bdf-10a2-46d9-bf8f-0c2e1546270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:50.116546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca3bdf-10a2-46d9-bf8f-0c2e1546270d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:50.116826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca3bdf-10a2-46d9-bf8f-0c2e1546270d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:50.117102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca3bdf-10a2-46d9-bf8f-0c2e1546270d admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:50.117819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca3bdf-10a2-46d9-bf8f-0c2e1546270d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:50.132532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca3bdf-10a2-46d9-bf8f-0c2e1546270d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:50.190623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 907/1795] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:01:50.197690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:50.246434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ecf89-5577-423d-8923-2c3d33f1a171 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:50.281499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29441bdd-ec36-4a9f-b519-0bf8e0a860e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:50.285541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29441bdd-ec36-4a9f-b519-0bf8e0a860e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:50.285835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29441bdd-ec36-4a9f-b519-0bf8e0a860e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:50.286109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29441bdd-ec36-4a9f-b519-0bf8e0a860e2 admin admin] PATH_INFO: `/v3/projects/19659b5c63ed4d648bd84fba70420395/users/7fd43ffc2a3243688bdd368d7fc54de9/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:50.298890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29441bdd-ec36-4a9f-b519-0bf8e0a860e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19659b5c63ed4d648bd84fba70420395, user_id=7fd43ffc2a3243688bdd368d7fc54de9, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:50.304746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29441bdd-ec36-4a9f-b519-0bf8e0a860e2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:50.347408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 889/1796] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:01:50 2022] PUT /identity/v3/projects/19659b5c63ed4d648bd84fba70420395/users/7fd43ffc2a3243688bdd368d7fc54de9/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:50.358111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01b54-7bc6-4875-946c-99b9a3fe0136 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:50.359801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01b54-7bc6-4875-946c-99b9a3fe0136 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:50.359801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01b54-7bc6-4875-946c-99b9a3fe0136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:50.368817 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c5965-b968-44ce-bbcb-cb80922eafee None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:50.369033 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c5965-b968-44ce-bbcb-cb80922eafee None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:50.369258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c5965-b968-44ce-bbcb-cb80922eafee None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:50.402123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 890/1797] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:01:50 2022] GET /identity => generated 270 bytes in 39 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:01:50.471250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:50.471542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:50.471812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:50.510747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9bd01b54-7bc6-4875-946c-99b9a3fe0136 None None] MFA Rules not processed for user `7fd43ffc2a3243688bdd368d7fc54de9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:50.520192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9bd01b54-7bc6-4875-946c-99b9a3fe0136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:50.539998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:50.542895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:50.675495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:50.828715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 908/1798] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:50.829611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 891/1799] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:01:50.838691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:50.838691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:50.838691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:50.854666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:50.859518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:50.913700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] MFA Rules not processed for user `35facb0f8769456d86fc13db4be34dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:50.917315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:51.064762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 909/1800] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:51.066470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:51.068948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:51.104424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3510-cfdf-4aff-88fc-51cec709a2ac None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:51.127645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:51.131431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:51.131863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c8000-d86c-4920-ac41-3554a3b509bc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:51.132042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:51.132797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:51.146588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:51.147500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:51.147932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:51.148601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:51.154624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:51.161420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:51.170235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:51.176725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:51.210408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 892/1801] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:50 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:51.252532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 910/1802] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:51.403317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:51.406768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:51.459021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea069bf-c7ff-49a4-820d-8e5054819710 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:51.479580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73cc85-c1c4-4c04-9c48-8d7e0e5638b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:51.480316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73cc85-c1c4-4c04-9c48-8d7e0e5638b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:51.480696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73cc85-c1c4-4c04-9c48-8d7e0e5638b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:51.481017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73cc85-c1c4-4c04-9c48-8d7e0e5638b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:51.490294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1f73cc85-c1c4-4c04-9c48-8d7e0e5638b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:51.696848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73cc85-c1c4-4c04-9c48-8d7e0e5638b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:51.700940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73cc85-c1c4-4c04-9c48-8d7e0e5638b8 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:51.733532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 893/1803] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:52.092850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:52.095037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:52.254813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:52.408183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6308e-5f26-4d4f-a1f6-28af9b131d9c service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:52.422688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:52.425860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:52.429591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:52.430461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] PATH_INFO: `/v3/users/339cec01fc014cfb921540acd111fdc6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:52.434798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=339cec01fc014cfb921540acd111fdc6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:52.441961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:52.670651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339cec01fc014cfb921540acd111fdc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:52.680135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339cec01fc014cfb921540acd111fdc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:52.681114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339cec01fc014cfb921540acd111fdc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:52.698931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339cec01fc014cfb921540acd111fdc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:52.756120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339cec01fc014cfb921540acd111fdc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:52.803622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 911/1804] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:52 2022] DELETE /identity/v3/users/339cec01fc014cfb921540acd111fdc6 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:52.808186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8ab1-2fe1-416d-9cb5-7ec73b6f4dd3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:52.808821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8ab1-2fe1-416d-9cb5-7ec73b6f4dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:52.808821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf8ab1-2fe1-416d-9cb5-7ec73b6f4dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:52.851518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d5bf8ab1-2fe1-416d-9cb5-7ec73b6f4dd3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:52.852946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d5bf8ab1-2fe1-416d-9cb5-7ec73b6f4dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:52.929590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:52.947642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 894/1805] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:53.030229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:53.033039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:53.291713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bac812-4220-4b3e-aec1-6dbb324c4e65 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:53.316110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85e305-4c88-4c3f-a9bf-513b4ee2a4a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:53.317262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e305-4c88-4c3f-a9bf-513b4ee2a4a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:53.317875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e305-4c88-4c3f-a9bf-513b4ee2a4a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:53.318655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85e305-4c88-4c3f-a9bf-513b4ee2a4a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:53.361734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85e305-4c88-4c3f-a9bf-513b4ee2a4a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:53.365416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85e305-4c88-4c3f-a9bf-513b4ee2a4a9 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:53.395363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 912/1806] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:01:53.596182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff1e31-dcbd-470c-aff3-b5526713efdd None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:53.596751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff1e31-dcbd-470c-aff3-b5526713efdd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:53.597303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff1e31-dcbd-470c-aff3-b5526713efdd None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:53.598924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 895/1807] 10.222.0.50 () {54 vars in 912 bytes} [Wed Sep 14 13:01:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 14 13:01:53.610037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:53.610450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:53.610804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:53.659708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] MFA Rules not processed for user `f5ca117fa96d412e9bda506591a01fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:53.671774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:53.703707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 913/1808] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:01:53.711245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff1e31-dcbd-470c-aff3-b5526713efdd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:53.713846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3aff1e31-dcbd-470c-aff3-b5526713efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:53.754163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff1e31-dcbd-470c-aff3-b5526713efdd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:53.763101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:53.763747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:53.763996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:53.764282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:53.799929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:53.802814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:53.816954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 896/1809] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:54.321549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:54.326887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:54.425429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2d682-e31e-4dac-8ef0-1e8bd6a565ad None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:54.438661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:54.439318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:54.439719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:54.440215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] PATH_INFO: `/v3/projects/94e828338d744000a42b6f1c0b10b862` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:54.459067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e828338d744000a42b6f1c0b10b862)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:54.463949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:54.643090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e828338d744000a42b6f1c0b10b862', 'request_id': 'req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:54.665767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e828338d744000a42b6f1c0b10b862', 'request_id': 'req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:54.690359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:54.693576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e828338d744000a42b6f1c0b10b862', 'request_id': 'req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:54.727662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] The token cache is being invalidate because project 94e828338d744000a42b6f1c0b10b862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:54.728049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:54.729601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-172e40b8-b876-4b8e-b2ec-02d9138ab6bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:54.736515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 914/1810] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:54 2022] DELETE /identity/v3/projects/94e828338d744000a42b6f1c0b10b862 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:54.740880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:54.782053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e8729-24b9-42fb-a39d-b1e7be5bea6f service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:55.025268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:55.026724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:55.032439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:55.047301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] PATH_INFO: `/v3/users/6859829b29ba491cbe0203aede5f39ad` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:55.050066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6859829b29ba491cbe0203aede5f39ad)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:55.052272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:55.264975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6859829b29ba491cbe0203aede5f39ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:55.268602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6859829b29ba491cbe0203aede5f39ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:55.269964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6859829b29ba491cbe0203aede5f39ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:55.308076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6859829b29ba491cbe0203aede5f39ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:55.346694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6859829b29ba491cbe0203aede5f39ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:55.366395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2985d9-e0f3-4f75-92f9-eb3f39889bb4 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:55.367377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2985d9-e0f3-4f75-92f9-eb3f39889bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:55.367909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2985d9-e0f3-4f75-92f9-eb3f39889bb4 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:55.369810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 915/1811] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:01:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:01:55.392987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 897/1812] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:54 2022] DELETE /identity/v3/users/6859829b29ba491cbe0203aede5f39ad => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:55.494696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:55.495619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:55.496269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:55.546078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:55.551458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:55.863453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 916/1813] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:56.947761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:56.950458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:56.995066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ea41a-dae1-4e84-b045-713c7529f0a6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:57.017061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:57.019444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:57.023218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:57.023882 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:57.051081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:57.065826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:57.107614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:57.110233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:57.114490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 898/1814] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:01:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:01:57.271542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:57.274664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:57.386909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf28df-716a-489e-a695-a524bc88230f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:57.398317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:57.399796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:57.409298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:57.410405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] PATH_INFO: `/v3/projects/0fc9ee8a9bf643199b166313dd8168e7` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:57.413119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc9ee8a9bf643199b166313dd8168e7)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:57.417225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:57.558041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc9ee8a9bf643199b166313dd8168e7', 'request_id': 'req-81fe19f1-7c4b-4026-878c-e0b404666b66'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:57.573011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc9ee8a9bf643199b166313dd8168e7', 'request_id': 'req-81fe19f1-7c4b-4026-878c-e0b404666b66'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:57.601132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:57.629054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc9ee8a9bf643199b166313dd8168e7', 'request_id': 'req-81fe19f1-7c4b-4026-878c-e0b404666b66'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:57.657851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898a422-1a26-4db3-a7b6-d1cfb2ade735 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:57.665239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] The token cache is being invalidate because project 0fc9ee8a9bf643199b166313dd8168e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:57.665557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:57.666280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:57.671381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 917/1815] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:57 2022] DELETE /identity/v3/projects/0fc9ee8a9bf643199b166313dd8168e7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:57.677354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:57.679312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:57.701033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:57.877659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:57.878318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:57.878589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:57.878866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] PATH_INFO: `/v3/projects/a61d54ca3fdb458d9eec98edb58308fe` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:57.883241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a61d54ca3fdb458d9eec98edb58308fe)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:57.886871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:57.957643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe19f1-7c4b-4026-878c-e0b404666b66 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:57.986955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:58.001529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:58.003995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:58.004941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] PATH_INFO: `/v3/users/e8e5273c3c1a4756994141905455ca9c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:58.020292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e5273c3c1a4756994141905455ca9c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:58.038442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:58.188941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a61d54ca3fdb458d9eec98edb58308fe', 'request_id': 'req-f7fc9bd0-c719-4742-bd28-80037c272791'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.236196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a61d54ca3fdb458d9eec98edb58308fe', 'request_id': 'req-f7fc9bd0-c719-4742-bd28-80037c272791'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.272461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a61d54ca3fdb458d9eec98edb58308fe', 'request_id': 'req-f7fc9bd0-c719-4742-bd28-80037c272791'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.343282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] The token cache is being invalidate because project a61d54ca3fdb458d9eec98edb58308fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:01:58.343779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.344942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f7fc9bd0-c719-4742-bd28-80037c272791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.347486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 899/1816] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:01:57 2022] DELETE /identity/v3/projects/a61d54ca3fdb458d9eec98edb58308fe => generated 0 bytes in 1077 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:58.355777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:58.356083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:58.356466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:58.368840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e5273c3c1a4756994141905455ca9c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.372737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e5273c3c1a4756994141905455ca9c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.377645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e5273c3c1a4756994141905455ca9c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.422730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:58.424658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:58.431894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e5273c3c1a4756994141905455ca9c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.514093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1dddf0fd-5520-4955-a25e-b6de165d2329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e5273c3c1a4756994141905455ca9c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:58.581145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 918/1817] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:57 2022] DELETE /identity/v3/users/e8e5273c3c1a4756994141905455ca9c => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:01:58.642600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 900/1818] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:58.652167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647684-b430-4c59-8662-9d347261342b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:58.652546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647684-b430-4c59-8662-9d347261342b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:58.652786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18647684-b430-4c59-8662-9d347261342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:58.695552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-18647684-b430-4c59-8662-9d347261342b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:58.702154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-18647684-b430-4c59-8662-9d347261342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:58.714163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:58.715672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:58.766201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84154657-408b-4aa7-924a-e4359b8c6be3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:58.925775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:58.987739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 919/1819] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:01:58.991618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647684-b430-4c59-8662-9d347261342b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:59.014058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18647684-b430-4c59-8662-9d347261342b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:59.032083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:59.035472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:59.040001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:59.041452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:59.043531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:01:59.045451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:59.053538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:59.074663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:59.076082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:59.076557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:59.077077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] PATH_INFO: `/v3/users/a4e1e0e6961549c09fbfe642d27bb48a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:59.084809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e1e0e6961549c09fbfe642d27bb48a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:59.104125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 920/1820] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:01:59.109019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:59.125411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:59.162208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e77cf-fea7-4dcb-987e-322523334b6e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:59.187303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:59.190905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:59.192746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:59.197044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:59.198857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:59.206590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:01:59.267694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:01:59.315704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 921/1821] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:01:59 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:01:59.315704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:01:59.378932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e1e0e6961549c09fbfe642d27bb48a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:59.380499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e1e0e6961549c09fbfe642d27bb48a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:59.381656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e1e0e6961549c09fbfe642d27bb48a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:59.439180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e1e0e6961549c09fbfe642d27bb48a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:59.519312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-18241448-951c-4064-820f-d4184008b3d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e1e0e6961549c09fbfe642d27bb48a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:01:59.604727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 901/1822] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:01:58 2022] DELETE /identity/v3/users/a4e1e0e6961549c09fbfe642d27bb48a => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:01:59.609743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:59.610246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:59.612243 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:59.697979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72300f48-fa51-4453-9989-438f2d9dc38e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:01:59.745770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:01:59.747986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:01:59.989129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:01:59.989768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:01:59.990090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:01:59.990314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:01:59.990956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:01:59.992924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:00.006111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 902/1823] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:00.064914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:00.065352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 922/1824] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:01:59 2022] POST /identity/v3/users => generated 289 bytes in 749 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:00.067433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:00.116111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862bba6-318a-441d-84bb-2b0ccf57fe71 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:00.127615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:00.130274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:00.130640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:00.131375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:00.133384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:00.135119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:00.135430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:00.143740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:00.198679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 903/1825] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:00.202950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:00.249382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f6c31-84a3-46b3-a0c1-7fab11b187d2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:00.271348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:00.272330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:00.272807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:00.273224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:00.279676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:00.285424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:00.319511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 904/1826] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:00.325151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:00.327018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3289da-df30-478e-86a1-c1e627609a9a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:00.342233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe111d7-9a21-4ed7-8663-974bfed3c65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:00.345980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe111d7-9a21-4ed7-8663-974bfed3c65d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:00.346320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe111d7-9a21-4ed7-8663-974bfed3c65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:00.346693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe111d7-9a21-4ed7-8663-974bfed3c65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:00.352398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52260db9-dceb-4adc-ae88-60b5d986d22a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:00.366836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:00.369778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:00.370374 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:00.370971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] PATH_INFO: `/v3/projects/3c8081d31195410d8e0919c9e07f21bb/users/6bf61faaf2d14b40964b2187e29d59c8/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:00.382234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe111d7-9a21-4ed7-8663-974bfed3c65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:00.383702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe111d7-9a21-4ed7-8663-974bfed3c65d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:00.447919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 923/1827] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:00.470363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c8081d31195410d8e0919c9e07f21bb, user_id=6bf61faaf2d14b40964b2187e29d59c8, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:00.477921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:00.515164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 905/1828] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:00 2022] PUT /identity/v3/projects/3c8081d31195410d8e0919c9e07f21bb/users/6bf61faaf2d14b40964b2187e29d59c8/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:00.526564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:00.526972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:00.527240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:00.560360 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] MFA Rules not processed for user `6bf61faaf2d14b40964b2187e29d59c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:00.561590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:00.585533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:00.649149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 924/1829] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:00.663341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:00.665309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:00.672736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:00.712963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:00.714446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:00.764590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d29c6c-28cf-4aa2-9ee2-45c81af19326 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:00.778653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab46a8-5f32-40c0-afb2-2d7d3ea4313b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:00.779288 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab46a8-5f32-40c0-afb2-2d7d3ea4313b service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:00.779572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab46a8-5f32-40c0-afb2-2d7d3ea4313b service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:00.779848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab46a8-5f32-40c0-afb2-2d7d3ea4313b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:00.801537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab46a8-5f32-40c0-afb2-2d7d3ea4313b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:00.803849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab46a8-5f32-40c0-afb2-2d7d3ea4313b service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:00.824931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 906/1830] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:00.881158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467fdb7-f3e1-4097-b5bf-c4266a734060 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:00.886585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:00.887180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:00.887521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:00.887868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] PATH_INFO: `/v3/projects/7d5bccc77a714b3b8bfd8a808427ecbb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:00.891812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d5bccc77a714b3b8bfd8a808427ecbb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:00.893934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.019535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d5bccc77a714b3b8bfd8a808427ecbb', 'request_id': 'req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.038037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d5bccc77a714b3b8bfd8a808427ecbb', 'request_id': 'req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.056178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d5bccc77a714b3b8bfd8a808427ecbb', 'request_id': 'req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.084337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] The token cache is being invalidate because project 7d5bccc77a714b3b8bfd8a808427ecbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:01.084774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.097747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0eb01ac0-caaf-4334-879a-8b3b6e9f1819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.108627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8330-065c-4598-bbf5-33ea58644f15 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.108840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 925/1831] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:00 2022] DELETE /identity/v3/projects/7d5bccc77a714b3b8bfd8a808427ecbb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:01.109281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8330-065c-4598-bbf5-33ea58644f15 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.110378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8330-065c-4598-bbf5-33ea58644f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.139092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ec5e8330-065c-4598-bbf5-33ea58644f15 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:01.141184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ec5e8330-065c-4598-bbf5-33ea58644f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:01.248493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 907/1832] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:01.251189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.251547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.251881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.326362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:01.331097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:01.352103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 926/1833] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:01.359057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8330-065c-4598-bbf5-33ea58644f15 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.359531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.361536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:01.371205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8330-065c-4598-bbf5-33ea58644f15 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.390414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c24a1-e9c9-4f72-9de4-ad71ea79f0b2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.403277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.403829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.403961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.404786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.405167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.405654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.405772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] PATH_INFO: `/v3/projects/13069d2e75e643aba379cf5a914ac387` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.405945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.406744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:01.407060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.407755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13069d2e75e643aba379cf5a914ac387)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.408720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.410762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.436179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 908/1834] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:01.438451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.461768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eed95-5230-4200-bb62-4627f4a21006 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.481676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.482381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.482569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.482958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.483542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.486884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.488700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:01.499695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13069d2e75e643aba379cf5a914ac387', 'request_id': 'req-dd199755-226b-4014-adb8-6b21ab4f56c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.508591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13069d2e75e643aba379cf5a914ac387', 'request_id': 'req-dd199755-226b-4014-adb8-6b21ab4f56c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.520339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13069d2e75e643aba379cf5a914ac387', 'request_id': 'req-dd199755-226b-4014-adb8-6b21ab4f56c9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.535724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] The token cache is being invalidate because project 13069d2e75e643aba379cf5a914ac387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:01.536176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.539674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.540262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 909/1835] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:01 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:01.541293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.545603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 927/1836] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:01 2022] DELETE /identity/v3/projects/13069d2e75e643aba379cf5a914ac387 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:01.545834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:01.547898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.551972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:01.640435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f40b3-97bc-45ec-9682-915fefe79c4b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.645857 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.646482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.646765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.647036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.647678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.649665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.653592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd199755-226b-4014-adb8-6b21ab4f56c9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.659757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.660658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.661150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.661428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] PATH_INFO: `/v3/users/7fd43ffc2a3243688bdd368d7fc54de9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.662822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fd43ffc2a3243688bdd368d7fc54de9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.664862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.674626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 910/1837] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:01 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:01.678281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.686355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:01.694840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfcf9b-bd7e-4c1d-9fe3-9d33ee74776c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.700487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.703557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.703858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.704230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.705457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.707182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.722665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 911/1838] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:01.728371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.741157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a91758-a4b1-4671-a138-55bae5a5f2e4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.744095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fd43ffc2a3243688bdd368d7fc54de9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.745178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fd43ffc2a3243688bdd368d7fc54de9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.745798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fd43ffc2a3243688bdd368d7fc54de9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.745913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.746520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.746802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.747077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.748549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.750302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.754995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fd43ffc2a3243688bdd368d7fc54de9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.761519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 912/1839] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:01.767473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:01.769275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-894d62f6-2b9b-45dd-ab54-a40afcdf36bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fd43ffc2a3243688bdd368d7fc54de9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:01.769428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:01.785191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169bf74-2e88-447c-90ae-39849a531d9e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:01.785445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 928/1840] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:01 2022] DELETE /identity/v3/users/7fd43ffc2a3243688bdd368d7fc54de9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:01.857919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:01.859222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.859538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.859820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] PATH_INFO: `/v3/projects/8d8bab957db642368d0e5065ce03db70/users/edc4f38721344e788b1b5198fa8435ec/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.880650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8bab957db642368d0e5065ce03db70, user_id=edc4f38721344e788b1b5198fa8435ec, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:01.883793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:01.908305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 913/1841] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:01 2022] PUT /identity/v3/projects/8d8bab957db642368d0e5065ce03db70/users/edc4f38721344e788b1b5198fa8435ec/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:01.920133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:01.920623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:01.921183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:01.959022 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] MFA Rules not processed for user `edc4f38721344e788b1b5198fa8435ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:01.960526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:02.000204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:02.056093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 929/1842] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:02.061045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.142338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f19f3b-ab08-4595-8b78-8c161b01aa8d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.147824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.148129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.148416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.148692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.149974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.152038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.187236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 914/1843] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:02 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:02.187976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.189382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.189708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:02.208851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b2564-43b1-4abb-82d6-6e48ed0039e2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.248609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:02.278907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebaad5-dcee-4fa5-9c59-22ce92cc956a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.285263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.286730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.287019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.287304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.288042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.289985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.302296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.303248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.303761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.304748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] PATH_INFO: `/v3/projects/19659b5c63ed4d648bd84fba70420395` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.306521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] RBAC: Authorizing `identity:delete_project(project_id=19659b5c63ed4d648bd84fba70420395)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.308689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.324365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 915/1844] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:02 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:02.326689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.345609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9d4e4-b4a9-4a8f-b556-0fbc3af7f755 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.352800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.353404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.353595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.353873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.354641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.356134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.371043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 916/1845] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:02.376478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.387792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f79c4-34fa-4d6d-9141-db48d0a4d3d6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.390564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19659b5c63ed4d648bd84fba70420395', 'request_id': 'req-49878238-e9e5-4bd3-99e8-006c5a78792c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:02.399047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19659b5c63ed4d648bd84fba70420395', 'request_id': 'req-49878238-e9e5-4bd3-99e8-006c5a78792c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:02.414731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19659b5c63ed4d648bd84fba70420395', 'request_id': 'req-49878238-e9e5-4bd3-99e8-006c5a78792c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:02.440605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] The token cache is being invalidate because project 19659b5c63ed4d648bd84fba70420395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:02.441872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:02.442880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-49878238-e9e5-4bd3-99e8-006c5a78792c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:02.448294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 930/1846] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:02 2022] DELETE /identity/v3/projects/19659b5c63ed4d648bd84fba70420395 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:02.454783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984ef9-5088-49f6-9bf5-ad17be64cdcd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.455071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984ef9-5088-49f6-9bf5-ad17be64cdcd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.455349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75984ef9-5088-49f6-9bf5-ad17be64cdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.508772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.509495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.509747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.510009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] PATH_INFO: `/v3/projects/4c1eb10fddfb402a8aab940362dee56c/users/710dc2e980f942c2a26d62e2fd0d3322/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.513648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-75984ef9-5088-49f6-9bf5-ad17be64cdcd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:02.519114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-75984ef9-5088-49f6-9bf5-ad17be64cdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:02.532446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1eb10fddfb402a8aab940362dee56c, user_id=710dc2e980f942c2a26d62e2fd0d3322, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.537397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.545692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 931/1847] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:02.556881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b25fe-8d17-4851-89e8-4b8447fb3859 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.557285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b25fe-8d17-4851-89e8-4b8447fb3859 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.557411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b25fe-8d17-4851-89e8-4b8447fb3859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.570543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 917/1848] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:02 2022] PUT /identity/v3/projects/4c1eb10fddfb402a8aab940362dee56c/users/710dc2e980f942c2a26d62e2fd0d3322/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:02.572964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.581953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:02.588874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5e6b25fe-8d17-4851-89e8-4b8447fb3859 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:02.592228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5e6b25fe-8d17-4851-89e8-4b8447fb3859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:02.689824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:02.705254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 932/1849] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:02.710429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b25fe-8d17-4851-89e8-4b8447fb3859 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.718549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746971-0d93-409e-a144-939707966e3a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.724164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.724882 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.725178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.725517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.726235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.726912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b25fe-8d17-4851-89e8-4b8447fb3859 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.728197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.737750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.739676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.739676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.740312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.741127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:02.741465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.743234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.764069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 918/1851] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:02.764451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 933/1851] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:02.767038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.769535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.786013 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86897af-1b1f-4ae6-93f6-90695fb78f19 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.797982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.798908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.799345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.799698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.801239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.802161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f9e19-67cc-43fe-b824-5f625d0a7fd6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:02.807150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.815202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b480c-6f77-4efb-9bbf-53f35a35be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:02.817850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b480c-6f77-4efb-9bbf-53f35a35be22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.818260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b480c-6f77-4efb-9bbf-53f35a35be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.818637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b480c-6f77-4efb-9bbf-53f35a35be22 admin admin] PATH_INFO: `/v3/projects/4c1eb10fddfb402a8aab940362dee56c/users/710dc2e980f942c2a26d62e2fd0d3322/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.827089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b480c-6f77-4efb-9bbf-53f35a35be22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1eb10fddfb402a8aab940362dee56c, user_id=710dc2e980f942c2a26d62e2fd0d3322, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:02.835321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b480c-6f77-4efb-9bbf-53f35a35be22 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:02.854685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 934/1852] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:02 2022] PUT /identity/v3/projects/4c1eb10fddfb402a8aab940362dee56c/users/710dc2e980f942c2a26d62e2fd0d3322/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:02.870625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:02.870805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:02.870992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:02.912954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 919/1853] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:02 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:02.914783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:02.938286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] MFA Rules not processed for user `710dc2e980f942c2a26d62e2fd0d3322`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:02.939311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:02.972159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:03.075302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc65e22-87d1-4a38-af45-3a0dcd7f0951 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.087099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.088786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.089544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.089962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.091190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.096143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.106766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 935/1854] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:03.116537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.118101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:03.141132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 920/1855] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:02 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:03.146519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.179394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a564d37-13e1-42db-84c3-40ef0e7f93bf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.189551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.190424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.190689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.191095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.192037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.193915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.210461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 921/1856] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:03.214917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.229629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec064f-975f-4d72-ae61-509a6e03003d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.237331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.238951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.239109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaf078-a7a7-4633-b274-7f0055b420b2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.239208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.239208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.240397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.242327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.248122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83863b60-c333-489a-be45-42d58b673c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.248936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863b60-c333-489a-be45-42d58b673c93 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.249570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863b60-c333-489a-be45-42d58b673c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.250416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863b60-c333-489a-be45-42d58b673c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.255436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 922/1857] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:03.259449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.263000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83863b60-c333-489a-be45-42d58b673c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.265716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83863b60-c333-489a-be45-42d58b673c93 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.270402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c301028-76bf-4572-a24a-07edd1ab85da admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.275802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.276532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.276815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.277092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] PATH_INFO: `/v3/projects/813b22b140f84bcd9002f2db4230772e/users/45eb12b2b9d346aba0f184f26c814098/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.279407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 936/1858] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:03.296782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=813b22b140f84bcd9002f2db4230772e, user_id=45eb12b2b9d346aba0f184f26c814098, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.299742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.318216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 923/1859] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:03 2022] PUT /identity/v3/projects/813b22b140f84bcd9002f2db4230772e/users/45eb12b2b9d346aba0f184f26c814098/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:03.331218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c7f8-e22c-492a-98cd-876b7331111b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.331610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c7f8-e22c-492a-98cd-876b7331111b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.331998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c7f8-e22c-492a-98cd-876b7331111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.366658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a9b3c7f8-e22c-492a-98cd-876b7331111b None None] MFA Rules not processed for user `45eb12b2b9d346aba0f184f26c814098`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:03.369167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a9b3c7f8-e22c-492a-98cd-876b7331111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:03.444220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:03.483261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 937/1860] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:03.486187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.597442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86463220-6d58-45fa-ab8b-735f3d08cea1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.603052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.603675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.604043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.604323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.604966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.606992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.674199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3c7f8-e22c-492a-98cd-876b7331111b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.675924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 924/1861] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:03 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:03.687721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3c7f8-e22c-492a-98cd-876b7331111b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.792381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.793121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.793407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.793679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.794775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.798220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.832064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 938/1862] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:03 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:03.835603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.858221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2dd179-df81-4f59-ab38-8f1bab0f87db admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.864664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.865186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.865469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.865746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.866442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.868041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.898733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 925/1863] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:03.899950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.917530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fce968a-1cb4-4214-b65c-ac252cb90bda admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:03.926239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:03.928400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:03.928829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:03.929376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] PATH_INFO: `/v3/projects/83ccd303f00346bf8c009de40a450eff/users/5144a0c449f54a3abf8da5b36df8b760/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:03.950765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ccd303f00346bf8c009de40a450eff, user_id=5144a0c449f54a3abf8da5b36df8b760, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:03.954028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:03.973892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 939/1864] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:03 2022] PUT /identity/v3/projects/83ccd303f00346bf8c009de40a450eff/users/5144a0c449f54a3abf8da5b36df8b760/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:03.978312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:03.992522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63711d-bdfb-4936-9b12-117981bb56cf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:04.081128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:04.146707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9b293-7aea-4542-a777-b40478c6dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:04.148088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b293-7aea-4542-a777-b40478c6dcb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:04.148511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b293-7aea-4542-a777-b40478c6dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:04.148910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9b293-7aea-4542-a777-b40478c6dcb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:04.149941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b293-7aea-4542-a777-b40478c6dcb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:04.154765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9b293-7aea-4542-a777-b40478c6dcb7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:04.176935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 926/1865] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:04.179124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:04.202160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7bc86-b3d6-4b46-8fc4-e70284a4253f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:04.238950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:04.242669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:04.242669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:04.242669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] PATH_INFO: `/v3/projects/83ccd303f00346bf8c009de40a450eff/users/5144a0c449f54a3abf8da5b36df8b760/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:04.245084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ccd303f00346bf8c009de40a450eff, user_id=5144a0c449f54a3abf8da5b36df8b760, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:04.249980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:04.269067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 940/1866] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:04 2022] PUT /identity/v3/projects/83ccd303f00346bf8c009de40a450eff/users/5144a0c449f54a3abf8da5b36df8b760/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:04.281129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94be87-0cba-4e5c-939c-b8eb7f31b74f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:04.282010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94be87-0cba-4e5c-939c-b8eb7f31b74f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:04.282495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94be87-0cba-4e5c-939c-b8eb7f31b74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:04.340834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fd94be87-0cba-4e5c-939c-b8eb7f31b74f None None] MFA Rules not processed for user `5144a0c449f54a3abf8da5b36df8b760`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:04.342645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fd94be87-0cba-4e5c-939c-b8eb7f31b74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:04.474062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 927/1867] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:04.496104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:04.497684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:04.595520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451f43e-9d2c-468d-8a9b-349b275cfbcb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:04.605621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:04.606292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:04.606581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:04.606860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:04.628054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:04.640625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:04.659880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 941/1868] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:04.924322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94be87-0cba-4e5c-939c-b8eb7f31b74f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:04.934767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94be87-0cba-4e5c-939c-b8eb7f31b74f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:04.939767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffe81a-1b54-4ba1-ac5b-3d4b645d292b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:04.940707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffe81a-1b54-4ba1-ac5b-3d4b645d292b service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:04.940989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffe81a-1b54-4ba1-ac5b-3d4b645d292b service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:04.941519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffe81a-1b54-4ba1-ac5b-3d4b645d292b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:05.103451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffe81a-1b54-4ba1-ac5b-3d4b645d292b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:05.109026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffe81a-1b54-4ba1-ac5b-3d4b645d292b service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:05.123402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 928/1869] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:05.907422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:05.994296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:06.032660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dc613-f547-47b3-b28a-8d01b1e46fe1 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:06.050805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:06.051589 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:06.051959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:06.052613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] PATH_INFO: `/v3/users/45eb12b2b9d346aba0f184f26c814098` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:06.055659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45eb12b2b9d346aba0f184f26c814098)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:06.061320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:06.215097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45eb12b2b9d346aba0f184f26c814098'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.217575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45eb12b2b9d346aba0f184f26c814098'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.217575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45eb12b2b9d346aba0f184f26c814098'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.234640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45eb12b2b9d346aba0f184f26c814098'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.254347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45eb12b2b9d346aba0f184f26c814098'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.290237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 942/1870] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:05 2022] DELETE /identity/v3/users/45eb12b2b9d346aba0f184f26c814098 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:06.297530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:06.299289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:06.299575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:06.351523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:06.353814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:06.462248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 929/1871] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:06.500578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:06.507451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:06.661118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cbed5-29e8-4760-994d-2cb8b66b39d5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:06.664997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cabbd9-ff70-4a1b-9635-e58d93c53a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:06.665852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cabbd9-ff70-4a1b-9635-e58d93c53a07 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:06.666135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cabbd9-ff70-4a1b-9635-e58d93c53a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:06.666409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cabbd9-ff70-4a1b-9635-e58d93c53a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:06.678840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:06.681780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:06.682231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cabbd9-ff70-4a1b-9635-e58d93c53a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:06.685142 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cabbd9-ff70-4a1b-9635-e58d93c53a07 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:06.692291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:06.701337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad96e63-054e-4d0e-b0ca-92aaaa4eee9d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:06.703468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 943/1872] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:06.708576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:06.709504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:06.709830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:06.710283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] PATH_INFO: `/v3/users/edc4f38721344e788b1b5198fa8435ec` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:06.714256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc4f38721344e788b1b5198fa8435ec)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:06.716504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:06.862278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc4f38721344e788b1b5198fa8435ec'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.864471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc4f38721344e788b1b5198fa8435ec'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.865468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc4f38721344e788b1b5198fa8435ec'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.875814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc4f38721344e788b1b5198fa8435ec'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.897869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc4f38721344e788b1b5198fa8435ec'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:06.923723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 930/1873] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:06 2022] DELETE /identity/v3/users/edc4f38721344e788b1b5198fa8435ec => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:06.928498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:06.928920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:06.929082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:06.978092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:06.979441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:07.157254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 944/1874] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:07.172490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:07.172490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:07.195722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:07.197496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:07.219494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b827a-9a22-40cc-847f-c3bda80b4b9b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:07.226563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:07.228243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:07.228724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:07.229981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] PATH_INFO: `/v3/projects/813b22b140f84bcd9002f2db4230772e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:07.231537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813b22b140f84bcd9002f2db4230772e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:07.235732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:07.240275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:07.331691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f2551-9d8d-49a7-9261-9b816dac5665 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:07.334987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813b22b140f84bcd9002f2db4230772e', 'request_id': 'req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.348387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813b22b140f84bcd9002f2db4230772e', 'request_id': 'req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.373248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813b22b140f84bcd9002f2db4230772e', 'request_id': 'req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.408719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] The token cache is being invalidate because project 813b22b140f84bcd9002f2db4230772e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:07.409055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.410584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.417445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 945/1875] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:07 2022] DELETE /identity/v3/projects/813b22b140f84bcd9002f2db4230772e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:07.420928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:07.423610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:07.481262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:07.481888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:07.482190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:07.482459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:07.485087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:07.647868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbcaeb-f0ae-4faf-b691-e744a5e7d0c3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:07.660379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:07.664883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:07.665219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:07.665532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] PATH_INFO: `/v3/users/5144a0c449f54a3abf8da5b36df8b760` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:07.667897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:07.669451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5144a0c449f54a3abf8da5b36df8b760)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:07.674846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:07.711730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:07.713673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:07.738587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 931/1876] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:07.756389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5144a0c449f54a3abf8da5b36df8b760'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.757181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5144a0c449f54a3abf8da5b36df8b760'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.757915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5144a0c449f54a3abf8da5b36df8b760'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.770497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5144a0c449f54a3abf8da5b36df8b760'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.790760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5144a0c449f54a3abf8da5b36df8b760'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:07.809169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 946/1877] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:07 2022] DELETE /identity/v3/users/5144a0c449f54a3abf8da5b36df8b760 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:08.218755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:08.226822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:08.228650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:08.234984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3c2e1-5bcf-455f-a667-428be888f65a service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:08.263247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:08.329453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:08.330392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:08.330678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:08.330955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] PATH_INFO: `/v3/projects/83ccd303f00346bf8c009de40a450eff` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:08.332251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ccd303f00346bf8c009de40a450eff)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:08.334576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:08.357035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5ef5-1b79-4258-938c-0a6b621eb834 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:08.365462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:08.367053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:08.367788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:08.368400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] PATH_INFO: `/v3/projects/8d8bab957db642368d0e5065ce03db70` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:08.370144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8bab957db642368d0e5065ce03db70)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:08.373091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:08.402306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ccd303f00346bf8c009de40a450eff', 'request_id': 'req-5438986e-772a-41f2-8026-481d9d601954'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.413373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ccd303f00346bf8c009de40a450eff', 'request_id': 'req-5438986e-772a-41f2-8026-481d9d601954'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.425610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ccd303f00346bf8c009de40a450eff', 'request_id': 'req-5438986e-772a-41f2-8026-481d9d601954'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.444225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] The token cache is being invalidate because project 83ccd303f00346bf8c009de40a450eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:08.444616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.445948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5438986e-772a-41f2-8026-481d9d601954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.447700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 932/1878] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:08 2022] DELETE /identity/v3/projects/83ccd303f00346bf8c009de40a450eff => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:08.454299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d24d8-deac-42ef-8be5-58fe8f4f384b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:08.456159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d24d8-deac-42ef-8be5-58fe8f4f384b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:08.456551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d24d8-deac-42ef-8be5-58fe8f4f384b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:08.463517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8bab957db642368d0e5065ce03db70', 'request_id': 'req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.484955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8bab957db642368d0e5065ce03db70', 'request_id': 'req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.492931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f48d24d8-deac-42ef-8be5-58fe8f4f384b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:08.495229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f48d24d8-deac-42ef-8be5-58fe8f4f384b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:08.500636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8bab957db642368d0e5065ce03db70', 'request_id': 'req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.519959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] The token cache is being invalidate because project 8d8bab957db642368d0e5065ce03db70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:08.520411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.522030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.523969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 947/1879] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:08 2022] DELETE /identity/v3/projects/8d8bab957db642368d0e5065ce03db70 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:08.528236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:08.530103 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:08.592176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 933/1880] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:08.597804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba80b-8ef3-405f-abb6-96e1588ad7ea None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:08.597804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba80b-8ef3-405f-abb6-96e1588ad7ea None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:08.597804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ba80b-8ef3-405f-abb6-96e1588ad7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:08.626650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a50ba80b-8ef3-405f-abb6-96e1588ad7ea None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:08.628131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a50ba80b-8ef3-405f-abb6-96e1588ad7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:08.649187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 934/1881] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:08.650722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a51005-03c5-44b0-97c0-ac869b1ca4bb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:08.653995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba80b-8ef3-405f-abb6-96e1588ad7ea None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:08.662303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:08.669165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ba80b-8ef3-405f-abb6-96e1588ad7ea None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:08.676096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:08.676618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:08.676834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:08.677114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] PATH_INFO: `/v3/users/710dc2e980f942c2a26d62e2fd0d3322` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:08.679683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:08.680529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:08.680808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:08.681074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:08.681719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:08.682110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:08.682210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710dc2e980f942c2a26d62e2fd0d3322)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:08.683950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:08.687716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:08.700363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 935/1882] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:02:08.706136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:08.720343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4758a5b-35e7-42f3-a768-582d66f4320c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:08.727436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:08.728534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:08.729172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:08.729508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:08.730462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:08.732560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:08.778535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 936/1883] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:08 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:08.781536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:08.807881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:08.815485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710dc2e980f942c2a26d62e2fd0d3322'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.818037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710dc2e980f942c2a26d62e2fd0d3322'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.818824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710dc2e980f942c2a26d62e2fd0d3322'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.828388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710dc2e980f942c2a26d62e2fd0d3322'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.866291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710dc2e980f942c2a26d62e2fd0d3322'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:08.904758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 948/1884] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:08 2022] DELETE /identity/v3/users/710dc2e980f942c2a26d62e2fd0d3322 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:08.991767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1eaa3-5d70-4084-b92a-806a523a2310 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:09.174542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:09.175391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.176517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.176517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.177272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:09.180390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:09.224155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 937/1885] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:08 2022] POST /identity/v3/users => generated 293 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:09.228686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:09.231853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:09.251712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeaa2cc-4b39-4450-b304-90c8e4644e22 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:09.261465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:09.262636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.263244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.263764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.265463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:09.277037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:09.310491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 949/1886] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:09.316052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:09.330009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32badc5c-ea0e-4150-b409-e055d92bfa51 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:09.336679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f735d8-098e-415b-8c47-9c66f6a4a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:09.337351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f735d8-098e-415b-8c47-9c66f6a4a14e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.337560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f735d8-098e-415b-8c47-9c66f6a4a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.338136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f735d8-098e-415b-8c47-9c66f6a4a14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.338531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f735d8-098e-415b-8c47-9c66f6a4a14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:09.340526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f735d8-098e-415b-8c47-9c66f6a4a14e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:09.364883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 938/1887] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:09.374442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:09.386494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3e191-aa39-4bd9-8410-3d07e155a25b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:09.407159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217308f-9b4d-4ac7-9ecd-5f4590a42087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:09.408116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217308f-9b4d-4ac7-9ecd-5f4590a42087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.408418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217308f-9b4d-4ac7-9ecd-5f4590a42087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.408780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217308f-9b4d-4ac7-9ecd-5f4590a42087 admin admin] PATH_INFO: `/v3/projects/6e271aa080ac4740b9b09f6f28eb2138/users/6ccdcfc23f7348eb80cb08281014c9e6/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.445196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217308f-9b4d-4ac7-9ecd-5f4590a42087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e271aa080ac4740b9b09f6f28eb2138, user_id=6ccdcfc23f7348eb80cb08281014c9e6, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:09.448149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217308f-9b4d-4ac7-9ecd-5f4590a42087 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:09.466461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 950/1888] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:09 2022] PUT /identity/v3/projects/6e271aa080ac4740b9b09f6f28eb2138/users/6ccdcfc23f7348eb80cb08281014c9e6/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:09.478006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.478290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.478565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.503792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281044-d569-4264-879c-96a542f60dca None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.504070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281044-d569-4264-879c-96a542f60dca None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.504276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7281044-d569-4264-879c-96a542f60dca None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.506128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 951/1889] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:02:09.515732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] MFA Rules not processed for user `6ccdcfc23f7348eb80cb08281014c9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:09.517477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:09.517791 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bb401-3aa4-45d5-bfc4-b6bacfdad7f1 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.518085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bb401-3aa4-45d5-bfc4-b6bacfdad7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.518366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bb401-3aa4-45d5-bfc4-b6bacfdad7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.545804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-505bb401-3aa4-45d5-bfc4-b6bacfdad7f1 None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:09.547995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-505bb401-3aa4-45d5-bfc4-b6bacfdad7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:09.590999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:09.640281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 939/1890] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:09.641758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:09.643365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:09.674708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 952/1891] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:09.675574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bb401-3aa4-45d5-bfc4-b6bacfdad7f1 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:09.741653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae02a1-612d-447b-a9df-be7a1a4b760b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:09.747179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:09.747565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.747949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.748347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] PATH_INFO: `/v3/projects/4c1eb10fddfb402a8aab940362dee56c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.750342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1eb10fddfb402a8aab940362dee56c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:09.752517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:09.764549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bb401-3aa4-45d5-bfc4-b6bacfdad7f1 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:09.773460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:09.776079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.776388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.776717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.777335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:09.779807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:09.818149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 953/1892] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:09 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:09.819231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:09.822832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:09.830354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:09.850037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1eb10fddfb402a8aab940362dee56c', 'request_id': 'req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:09.859797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1eb10fddfb402a8aab940362dee56c', 'request_id': 'req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:09.871190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1eb10fddfb402a8aab940362dee56c', 'request_id': 'req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:09.891363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] The token cache is being invalidate because project 4c1eb10fddfb402a8aab940362dee56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:09.891841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:09.892783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:09.895003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 940/1893] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:09 2022] DELETE /identity/v3/projects/4c1eb10fddfb402a8aab940362dee56c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:09.898528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:09.898528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:09.936221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd92d3-1567-4b60-9e21-825af227a2a0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:09.943608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3058f17-5b75-40da-a1e7-0a95b6b1c98d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:09.944627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3058f17-5b75-40da-a1e7-0a95b6b1c98d service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.945060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3058f17-5b75-40da-a1e7-0a95b6b1c98d service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.945338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3058f17-5b75-40da-a1e7-0a95b6b1c98d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:09.947930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a3058f17-5b75-40da-a1e7-0a95b6b1c98d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:09.971417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3058f17-5b75-40da-a1e7-0a95b6b1c98d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:09.973326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3058f17-5b75-40da-a1e7-0a95b6b1c98d service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:09.997486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 954/1894] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:09.998675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267b32-31df-40ab-8296-23df3280dea0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:09.999498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267b32-31df-40ab-8296-23df3280dea0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:09.999877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1267b32-31df-40ab-8296-23df3280dea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.028449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c3c19-ce0a-4f11-8ae6-5c91e24242b9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.030433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b1267b32-31df-40ab-8296-23df3280dea0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:10.031797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b1267b32-31df-40ab-8296-23df3280dea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:10.060186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:10.135603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.136379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.136823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.137275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.138221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.141915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.155028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 955/1895] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:10.164334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784fa19-6c42-4cd4-990e-bff5f7f0f46f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.165706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784fa19-6c42-4cd4-990e-bff5f7f0f46f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.166433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784fa19-6c42-4cd4-990e-bff5f7f0f46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.190411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 941/1896] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:09 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:10.195128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.198434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7784fa19-6c42-4cd4-990e-bff5f7f0f46f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:10.199350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7784fa19-6c42-4cd4-990e-bff5f7f0f46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:10.212928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75506e-23ee-486e-818f-6c36a286750c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.235173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 956/1897] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:10.236677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.236875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784fa19-6c42-4cd4-990e-bff5f7f0f46f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.237470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.237962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.238274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.239178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.241835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.267023 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784fa19-6c42-4cd4-990e-bff5f7f0f46f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.272702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 942/1898] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:10.273776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.286173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.286820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.287298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.287464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.288149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:10.288460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.290171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.291041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71179481-61c9-4951-9199-92ab8a7edf53 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.304280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.306613 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.306958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.307259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.309455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.312981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.320139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 957/1899] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:10.321727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.336483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ad80b-e1ec-4d28-8dae-0a9c18e6f95c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.346643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.347305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.347653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.347993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.348862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.351098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.367147 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 943/1900] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:10.368968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.397440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 958/1901] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:10 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:10.398489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.415995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba2f88-c6c9-4b00-b704-68a25d06b3a0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.487948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:10.529770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a252523-4481-4472-95eb-dcd732afe745 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.551176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.553361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.555632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.559487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.561854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.566206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.585827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68034e-60bb-4262-9465-9f2ed374a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.587314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68034e-60bb-4262-9465-9f2ed374a1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.589355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68034e-60bb-4262-9465-9f2ed374a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.589724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68034e-60bb-4262-9465-9f2ed374a1cc admin admin] PATH_INFO: `/v3/projects/5afc8c8189ab41ee98d9c8c0b5848d15/users/c5d2a808965940bea8c39d3c7fc7326b/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.643156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 959/1902] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:10 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:10.646843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.662043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68034e-60bb-4262-9465-9f2ed374a1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afc8c8189ab41ee98d9c8c0b5848d15, user_id=c5d2a808965940bea8c39d3c7fc7326b, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.672076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7421a65-6b42-4619-9bda-60b2212ffba6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.672572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68034e-60bb-4262-9465-9f2ed374a1cc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.680627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.681518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.683376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.683704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.687423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.690980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.692261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 944/1903] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:10 2022] PUT /identity/v3/projects/5afc8c8189ab41ee98d9c8c0b5848d15/users/c5d2a808965940bea8c39d3c7fc7326b/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:10.704674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d14c66-8d2f-471d-b78b-2ef431c2d72c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.704982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d14c66-8d2f-471d-b78b-2ef431c2d72c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.705276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d14c66-8d2f-471d-b78b-2ef431c2d72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.719560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 960/1904] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:10.721551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.744899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21fe11-56fe-4657-90dc-d7f71e862a98 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.755971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-83d14c66-8d2f-471d-b78b-2ef431c2d72c None None] MFA Rules not processed for user `c5d2a808965940bea8c39d3c7fc7326b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:10.757674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-83d14c66-8d2f-471d-b78b-2ef431c2d72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:10.867181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.867654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.868006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.869473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.870321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.872259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.895084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 945/1905] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:10.900934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d14c66-8d2f-471d-b78b-2ef431c2d72c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.910044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 961/1906] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:10.910779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:10.911725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:10.929032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d14c66-8d2f-471d-b78b-2ef431c2d72c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.934641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b24af-780b-42cf-afe9-4f7ec190d2ce admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:10.940286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.941385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.941888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.943466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:10.944785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:10.947062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:10.953915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d947-8a9e-4d68-a963-d48bbba151af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:10.954811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d947-8a9e-4d68-a963-d48bbba151af admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:10.955107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d947-8a9e-4d68-a963-d48bbba151af admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:10.955390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d947-8a9e-4d68-a963-d48bbba151af admin admin] PATH_INFO: `/v3/projects/ebbaea7a2fe94c2396ca62c2147ed16d/users/fe024aea05484a5aaf1aafaab5f937b8/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.009347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 946/1907] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:10 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:11.010457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.016045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d947-8a9e-4d68-a963-d48bbba151af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbaea7a2fe94c2396ca62c2147ed16d, user_id=fe024aea05484a5aaf1aafaab5f937b8, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.032524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d947-8a9e-4d68-a963-d48bbba151af admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.083313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 962/1908] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:10 2022] PUT /identity/v3/projects/ebbaea7a2fe94c2396ca62c2147ed16d/users/fe024aea05484a5aaf1aafaab5f937b8/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:11.094966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6c9a-66c8-4293-b761-02347fdc8808 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.095332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6c9a-66c8-4293-b761-02347fdc8808 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.095618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb6c9a-66c8-4293-b761-02347fdc8808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.127282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689fdad-5bbf-4c3a-94e7-43e138dc5727 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.131261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c2bb6c9a-66c8-4293-b761-02347fdc8808 None None] MFA Rules not processed for user `fe024aea05484a5aaf1aafaab5f937b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:11.132806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c2bb6c9a-66c8-4293-b761-02347fdc8808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:11.221376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.222211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.222595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.222883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.223564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.227239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.244433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 963/1909] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:11.248641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb6c9a-66c8-4293-b761-02347fdc8808 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.276069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 947/1910] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:11 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:11.276069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.276553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb6c9a-66c8-4293-b761-02347fdc8808 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.278358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381fc8-44f5-45ad-bc8a-39278428daf6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.279549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.280524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.280869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.281385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.282165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.283664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.284317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.284490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.284646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.284958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.285610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.287268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.309803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 948/1911] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:11.311060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.325801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16ab7-84ec-46cd-892c-35cfeae9acdf admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.333383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.333798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.334153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.334583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] PATH_INFO: `/v3/projects/853fa4514d59413794ecec3488ef2f6a/users/aac97f34593c45eeae3c2f2a3836f47e/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.334744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 964/1912] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:11 2022] POST /identity/v3/projects => generated 385 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:11.335824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.343558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:11.359719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=853fa4514d59413794ecec3488ef2f6a, user_id=aac97f34593c45eeae3c2f2a3836f47e, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.362829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.384116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 949/1913] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:11 2022] PUT /identity/v3/projects/853fa4514d59413794ecec3488ef2f6a/users/aac97f34593c45eeae3c2f2a3836f47e/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:11.388217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.441649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686dbe4-dc0b-4d3c-abdd-abc82c8ab150 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.459428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:11.483703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bcf1b-bb8a-4826-973f-a9809f75ecdc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.489231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.489899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.490185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.491022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.491489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.493229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.506221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 950/1914] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:11.510498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.516654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.517592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.517848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.518332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.519173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.521098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.530870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336c8cc-f696-48a4-886b-3714f7941a2a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.538487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd109d-a6dc-4a75-9443-4b4ef4c80384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.539306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd109d-a6dc-4a75-9443-4b4ef4c80384 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.539725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd109d-a6dc-4a75-9443-4b4ef4c80384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.540137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd109d-a6dc-4a75-9443-4b4ef4c80384 admin admin] PATH_INFO: `/v3/projects/853fa4514d59413794ecec3488ef2f6a/users/aac97f34593c45eeae3c2f2a3836f47e/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.542905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd109d-a6dc-4a75-9443-4b4ef4c80384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853fa4514d59413794ecec3488ef2f6a, user_id=aac97f34593c45eeae3c2f2a3836f47e, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.546806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd109d-a6dc-4a75-9443-4b4ef4c80384 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.552946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 965/1915] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:11 2022] POST /identity/v3/users => generated 299 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:11.558379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.559975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 951/1916] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:11 2022] PUT /identity/v3/projects/853fa4514d59413794ecec3488ef2f6a/users/aac97f34593c45eeae3c2f2a3836f47e/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:11.569392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070095-862d-478f-997c-8ebd3c5901f5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.571746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.572070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.572350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.605622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] MFA Rules not processed for user `aac97f34593c45eeae3c2f2a3836f47e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:11.606851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:11.650067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.650804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.651089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.652041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.652832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.657031 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.674668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 966/1917] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:11.675713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.687009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce06aa-a331-47b4-88f0-22cf9b614bce admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.694182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 952/1918] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:11.701007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.702797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.703145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.703619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] PATH_INFO: `/v3/projects/630f0383863e4813b80b55cdf55e2fc0/users/d48047f085cf404887f728c40489d4a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.720595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.724049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:11.752925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630f0383863e4813b80b55cdf55e2fc0, user_id=d48047f085cf404887f728c40489d4a6, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.762372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.795662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 967/1919] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:11 2022] PUT /identity/v3/projects/630f0383863e4813b80b55cdf55e2fc0/users/d48047f085cf404887f728c40489d4a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:11.802312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.802608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a98b51-1673-496a-8867-035b78ffbb5b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.837208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:11.899624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f9edb-56ec-4bb6-be7b-d0e6dce2a269 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.906663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.907295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.907576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.907851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.908778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.910426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:11.935767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 968/1920] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:11.937979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:11.962141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f528dd-ff38-400b-a07c-7178a34bb803 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:11.965391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.967185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.968152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.968948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.972508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:11.980571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e6954-1fb4-499c-b484-6ba758428390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:11.980571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6954-1fb4-499c-b484-6ba758428390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:11.980856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6954-1fb4-499c-b484-6ba758428390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:11.981160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e6954-1fb4-499c-b484-6ba758428390 admin admin] PATH_INFO: `/v3/projects/630f0383863e4813b80b55cdf55e2fc0/users/d48047f085cf404887f728c40489d4a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:11.983153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e6954-1fb4-499c-b484-6ba758428390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630f0383863e4813b80b55cdf55e2fc0, user_id=d48047f085cf404887f728c40489d4a6, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:11.986653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e6954-1fb4-499c-b484-6ba758428390 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:12.004055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 969/1921] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:11 2022] PUT /identity/v3/projects/630f0383863e4813b80b55cdf55e2fc0/users/d48047f085cf404887f728c40489d4a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:12.038215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d768c-703e-4a17-85bb-226cdcfec0a2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:12.039064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d768c-703e-4a17-85bb-226cdcfec0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:12.039556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d768c-703e-4a17-85bb-226cdcfec0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:12.064326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:12.092746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-694d768c-703e-4a17-85bb-226cdcfec0a2 None None] MFA Rules not processed for user `d48047f085cf404887f728c40489d4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:12.094560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-694d768c-703e-4a17-85bb-226cdcfec0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:12.111821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:12.114232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:12.127141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 953/1922] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:12.197876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 970/1923] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:12.297351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:12.298755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:12.323523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730cac2-110e-4f16-bf72-e199b604c92f service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:12.408221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236b6c5-f146-4d88-91c4-7141f96e0af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:12.408853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b6c5-f146-4d88-91c4-7141f96e0af1 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:12.408853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b6c5-f146-4d88-91c4-7141f96e0af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:12.409216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236b6c5-f146-4d88-91c4-7141f96e0af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:12.424442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b6c5-f146-4d88-91c4-7141f96e0af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:12.426358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c236b6c5-f146-4d88-91c4-7141f96e0af1 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:12.455176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 954/1924] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:12.678990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d768c-703e-4a17-85bb-226cdcfec0a2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:12.797484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694d768c-703e-4a17-85bb-226cdcfec0a2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:12.803409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:12.804246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:12.804655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:12.804930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] PATH_INFO: `/v3/users/fe024aea05484a5aaf1aafaab5f937b8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:12.806225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe024aea05484a5aaf1aafaab5f937b8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:12.809085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:12.845368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:12.877241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe024aea05484a5aaf1aafaab5f937b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:12.878042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe024aea05484a5aaf1aafaab5f937b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:12.878810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe024aea05484a5aaf1aafaab5f937b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:12.886672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe024aea05484a5aaf1aafaab5f937b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:12.899575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe024aea05484a5aaf1aafaab5f937b8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:12.916715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 971/1925] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:12 2022] DELETE /identity/v3/users/fe024aea05484a5aaf1aafaab5f937b8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:12.922278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:12.922727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:12.923071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:12.944589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:12.945884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:13.013033 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 955/1926] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:13.024350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:13.025929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:13.140433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2123a-f629-4542-b989-518cccbf698a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:13.145258 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:13.146026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:13.146377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:13.146855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:13.162959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:13.164781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:13.180401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 972/1927] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:13.878203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:13.879933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:13.906830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7dcd04-b8da-4c47-9c5d-13880ae6b642 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:13.934108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:13.946685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:13.946984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:13.947332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] PATH_INFO: `/v3/projects/ebbaea7a2fe94c2396ca62c2147ed16d` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:13.949369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbaea7a2fe94c2396ca62c2147ed16d)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:13.951909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:14.048316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbaea7a2fe94c2396ca62c2147ed16d', 'request_id': 'req-ce91e24d-684f-4ef4-bd53-fc6b885a040b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.062825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbaea7a2fe94c2396ca62c2147ed16d', 'request_id': 'req-ce91e24d-684f-4ef4-bd53-fc6b885a040b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.070460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:14.071498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:14.074416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:14.111009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbaea7a2fe94c2396ca62c2147ed16d', 'request_id': 'req-ce91e24d-684f-4ef4-bd53-fc6b885a040b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.133122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] The token cache is being invalidate because project ebbaea7a2fe94c2396ca62c2147ed16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:14.133420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.134216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.135816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 956/1928] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:13 2022] DELETE /identity/v3/projects/ebbaea7a2fe94c2396ca62c2147ed16d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:14.140793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:14.142317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:14.169564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631422d2-d538-443b-b3bd-ae9af8aa6e98 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:14.246704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91e24d-684f-4ef4-bd53-fc6b885a040b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:14.254253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:14.255335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:14.255652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:14.256069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:14.256356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:14.256597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:14.256701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:14.257176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] PATH_INFO: `/v3/users/d48047f085cf404887f728c40489d4a6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:14.259211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:14.259463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48047f085cf404887f728c40489d4a6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:14.262738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:14.275878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:14.336399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48047f085cf404887f728c40489d4a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.338498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48047f085cf404887f728c40489d4a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.339190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48047f085cf404887f728c40489d4a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.349827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48047f085cf404887f728c40489d4a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.363656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:14.365827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:14.368176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4737cafc-a947-4db2-a984-1c771e14f279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48047f085cf404887f728c40489d4a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:14.378696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 973/1929] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:14.391097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 957/1930] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:14 2022] DELETE /identity/v3/users/d48047f085cf404887f728c40489d4a6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:14.866836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:14.885264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a4320-4e17-4169-9198-d7da9241d28a service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.016670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.017001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.017366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.017697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] PATH_INFO: `/v3/projects/630f0383863e4813b80b55cdf55e2fc0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.019034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=630f0383863e4813b80b55cdf55e2fc0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.021481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:15.111126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630f0383863e4813b80b55cdf55e2fc0', 'request_id': 'req-2fc051b9-dfd2-4423-8562-1bf885aab63a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.117098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630f0383863e4813b80b55cdf55e2fc0', 'request_id': 'req-2fc051b9-dfd2-4423-8562-1bf885aab63a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.156354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630f0383863e4813b80b55cdf55e2fc0', 'request_id': 'req-2fc051b9-dfd2-4423-8562-1bf885aab63a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.189150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] The token cache is being invalidate because project 630f0383863e4813b80b55cdf55e2fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:15.189914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.191821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.193432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 974/1931] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:14 2022] DELETE /identity/v3/projects/630f0383863e4813b80b55cdf55e2fc0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:15.199244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb45e-82b5-47bb-9508-7af452c0737a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.199802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb45e-82b5-47bb-9508-7af452c0737a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.199802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacfb45e-82b5-47bb-9508-7af452c0737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.234283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dacfb45e-82b5-47bb-9508-7af452c0737a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:15.235894 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dacfb45e-82b5-47bb-9508-7af452c0737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.348472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 958/1932] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:15.348556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:15.348556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.355200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c3e49-d1f3-481f-9bed-d022b2b35d74 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.355673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c3e49-d1f3-481f-9bed-d022b2b35d74 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.357066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c3e49-d1f3-481f-9bed-d022b2b35d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.364282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc051b9-dfd2-4423-8562-1bf885aab63a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.370208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.371026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.371411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.371802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] PATH_INFO: `/v3/users/6bf61faaf2d14b40964b2187e29d59c8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.373403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf61faaf2d14b40964b2187e29d59c8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.376352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:15.383899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:15.400277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-875c3e49-d1f3-481f-9bed-d022b2b35d74 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:15.409258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-875c3e49-d1f3-481f-9bed-d022b2b35d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.428140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 959/1933] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:15.433080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c3e49-d1f3-481f-9bed-d022b2b35d74 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:15.445721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:15.449042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c3e49-d1f3-481f-9bed-d022b2b35d74 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.455881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.457323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.457922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.458392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.459810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf61faaf2d14b40964b2187e29d59c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.460186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:15.460488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf61faaf2d14b40964b2187e29d59c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.460923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.461393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf61faaf2d14b40964b2187e29d59c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.463653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:15.476354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf61faaf2d14b40964b2187e29d59c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.486213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 960/1934] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:15.491335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:15.494960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.508749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf61faaf2d14b40964b2187e29d59c8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:15.520931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c1330-a067-4a70-abc3-3e64a9e9c964 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.528570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2089d57-55d1-492d-b19b-3eb849315f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.529324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d57-55d1-492d-b19b-3eb849315f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.529556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d57-55d1-492d-b19b-3eb849315f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.530100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2089d57-55d1-492d-b19b-3eb849315f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.530689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2089d57-55d1-492d-b19b-3eb849315f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.533519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2089d57-55d1-492d-b19b-3eb849315f8d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:15.545104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 975/1935] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:15 2022] DELETE /identity/v3/users/6bf61faaf2d14b40964b2187e29d59c8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:15.548305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:15.552494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.606783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 961/1936] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:15 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:15.606783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5fd4f-1a3d-44f9-9219-c39258259a98 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.606783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5fd4f-1a3d-44f9-9219-c39258259a98 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.606783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5fd4f-1a3d-44f9-9219-c39258259a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.670830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d8e5fd4f-1a3d-44f9-9219-c39258259a98 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:15.677765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d8e5fd4f-1a3d-44f9-9219-c39258259a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.714094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac1f7-c7a5-47b5-b421-bf7c5a724d57 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.835527 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.836190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.836474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.836751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.843621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 962/1937] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:15.844950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5fd4f-1a3d-44f9-9219-c39258259a98 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:15.845092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.859564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5fd4f-1a3d-44f9-9219-c39258259a98 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.871349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.872689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.873365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.875102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.877695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.881530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:15.911186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 963/1938] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:15 2022] POST /identity/v3/users => generated 291 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:15.911186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:15.911186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:15.955548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.956977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:15.967750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 976/1939] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:15.969248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:15.977892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9b08d-430c-4bf4-8112-f56b3491e670 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.980732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c9844-82c4-4761-8443-26f12569f266 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:15.982765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.983719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.983910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.984203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.986613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:15.987441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:15.987720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:15.987992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:15.988664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.990270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:15.996674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:15.998150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:16.007189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 977/1940] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:16.011327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:16.024126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 964/1941] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:16.024385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c367-9453-4ae0-88cd-c296c4bed80c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:16.032520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3addbe30-b554-4233-8779-f0cf8d52ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:16.033557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addbe30-b554-4233-8779-f0cf8d52ba2a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:16.037462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addbe30-b554-4233-8779-f0cf8d52ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:16.046511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3addbe30-b554-4233-8779-f0cf8d52ba2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:16.052326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addbe30-b554-4233-8779-f0cf8d52ba2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:16.056604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3addbe30-b554-4233-8779-f0cf8d52ba2a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:16.068328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:16.083058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 978/1942] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:16.084563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:16.099277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7e900-18ca-47de-ad23-679c3c338592 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:16.111021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:16.111715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:16.112080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:16.112425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] PATH_INFO: `/v3/projects/60c96e4c54934ebf98be61808603c0ea/users/1e3eb4e29d5749b0af4e6ca6479b29e4/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:16.143506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c96e4c54934ebf98be61808603c0ea, user_id=1e3eb4e29d5749b0af4e6ca6479b29e4, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:16.147610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:16.175997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 965/1943] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:16 2022] PUT /identity/v3/projects/60c96e4c54934ebf98be61808603c0ea/users/1e3eb4e29d5749b0af4e6ca6479b29e4/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:16.198493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:16.199243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:16.199601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:16.299509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] MFA Rules not processed for user `1e3eb4e29d5749b0af4e6ca6479b29e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:16.322298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:16.523049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 979/1944] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:16.529950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:16.610411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:16.734832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f0f6-6862-4cba-83b0-14e97667c817 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:16.783218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:16.785226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:16.785692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:16.786917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:16.787867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:16.794027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:16.818507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:16.819259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:16.844407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8e5b-071a-4675-b576-d2c185136544 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:16.854646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:16.859509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:16.860173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:16.860719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] PATH_INFO: `/v3/projects/3c8081d31195410d8e0919c9e07f21bb` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:16.862498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c8081d31195410d8e0919c9e07f21bb)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:16.864796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:16.878279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 966/1945] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:16 2022] POST /identity/v3/projects => generated 381 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:16.880475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:16.957987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c8081d31195410d8e0919c9e07f21bb', 'request_id': 'req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:16.971847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c8081d31195410d8e0919c9e07f21bb', 'request_id': 'req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:16.987083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c8081d31195410d8e0919c9e07f21bb', 'request_id': 'req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:17.011108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] The token cache is being invalidate because project 3c8081d31195410d8e0919c9e07f21bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:17.011108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:17.015822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-92f4ebf9-9f36-4ccd-a3bd-7ad1f94a77d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:17.018722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 980/1946] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:16 2022] DELETE /identity/v3/projects/3c8081d31195410d8e0919c9e07f21bb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:17.024137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b89f72-c996-4924-8120-5f92f7445c42 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.024476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b89f72-c996-4924-8120-5f92f7445c42 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.024686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b89f72-c996-4924-8120-5f92f7445c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.031171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09182d21-3368-484d-8544-81d957cb7855 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.047647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-14b89f72-c996-4924-8120-5f92f7445c42 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:17.049055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-14b89f72-c996-4924-8120-5f92f7445c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:17.138439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.140140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.141000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.142077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.143497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.147932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.187256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 967/1947] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:16 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:17.191375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.195937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:17.212170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 981/1948] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:17.222860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd2f5-c852-431e-9f71-7cfc1190ce0f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.223248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd2f5-c852-431e-9f71-7cfc1190ce0f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.223978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bd2f5-c852-431e-9f71-7cfc1190ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.227470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5bc876-3b1b-4c0c-aa1e-5d297a600c6a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.253710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.254626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.254936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.255309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.256957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.257144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-699bd2f5-c852-431e-9f71-7cfc1190ce0f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:17.257727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.258302 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-699bd2f5-c852-431e-9f71-7cfc1190ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:17.269353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 982/1949] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:17.273190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd2f5-c852-431e-9f71-7cfc1190ce0f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.275673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 968/1950] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:17.281023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.291896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bd2f5-c852-431e-9f71-7cfc1190ce0f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.297015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.298161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.298161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.299646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.301404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:17.301927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.304422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569a16e-6993-4a14-ac39-3d4a37628558 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.305568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.307345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:17.309836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.310555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.310840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.311200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] PATH_INFO: `/v3/projects/ae035c89a0334357ae4aec7a008b3c7a/users/00587cf1c76d4d0e97b2f4b67881758a/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.334550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 983/1951] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:02:17.340476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.348637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae035c89a0334357ae4aec7a008b3c7a, user_id=00587cf1c76d4d0e97b2f4b67881758a, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.351989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.353466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a659f-9ca5-4323-89f9-a506ff988a43 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.363596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.365015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.365015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.365429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.366836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.369169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.370988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 969/1952] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:17 2022] PUT /identity/v3/projects/ae035c89a0334357ae4aec7a008b3c7a/users/00587cf1c76d4d0e97b2f4b67881758a/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:17.376409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.397190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:17.427348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 984/1953] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:17 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:17.432730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.498040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373de1c2-2e74-4cd2-be2f-0a4e642bd32a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.559664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5056a98-e711-4f85-adaa-3198d83c9575 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.570376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.571170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.571550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.571877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.572644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.574768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.587605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.589790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.590851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.591295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.591981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.594101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.607318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 970/1954] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:17.617201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.637284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7504c-39ea-4b14-93b4-cdf15919bada admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.645194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887f17-0fe7-4ccd-9c81-22febd530404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.645867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887f17-0fe7-4ccd-9c81-22febd530404 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.646146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887f17-0fe7-4ccd-9c81-22febd530404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.646419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887f17-0fe7-4ccd-9c81-22febd530404 admin admin] PATH_INFO: `/v3/projects/ae035c89a0334357ae4aec7a008b3c7a/users/00587cf1c76d4d0e97b2f4b67881758a/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.648476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82887f17-0fe7-4ccd-9c81-22febd530404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae035c89a0334357ae4aec7a008b3c7a, user_id=00587cf1c76d4d0e97b2f4b67881758a, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.651858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82887f17-0fe7-4ccd-9c81-22febd530404 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.678629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 971/1955] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:17 2022] PUT /identity/v3/projects/ae035c89a0334357ae4aec7a008b3c7a/users/00587cf1c76d4d0e97b2f4b67881758a/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:17.692679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.693572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.694070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.697857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 985/1956] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:17 2022] POST /identity/v3/users => generated 287 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:17.698760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.732731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93970a-708b-4ea0-8a63-797ecc097882 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.734395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] MFA Rules not processed for user `00587cf1c76d4d0e97b2f4b67881758a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:17.735716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:17.840476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.841374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.841844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.842397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.844077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.846949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.869823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 986/1957] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:17.871824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.874943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 972/1958] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:17.893060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.894557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f37f6e-9ee6-4f76-9e2d-532daf0c0799 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.895813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:17.901676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.902377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.902772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.903488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.904976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.907626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.928402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 987/1959] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:17.933011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:17.942586 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:17.946011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a01bd1-87df-4897-986f-a7353ea4f800 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.952911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5484d55-0882-407e-a71d-f86a3ca7a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.953833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5484d55-0882-407e-a71d-f86a3ca7a154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.954324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5484d55-0882-407e-a71d-f86a3ca7a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.955046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5484d55-0882-407e-a71d-f86a3ca7a154 admin admin] PATH_INFO: `/v3/projects/653fa3ff8bb84850b7cf7e2e133fb240/users/0a6dde8a3e564a65a60191569421a8b8/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:17.982602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5484d55-0882-407e-a71d-f86a3ca7a154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653fa3ff8bb84850b7cf7e2e133fb240, user_id=0a6dde8a3e564a65a60191569421a8b8, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:17.990877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a222-3416-4405-a2ed-ef1a8bf38b7c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:17.992104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5484d55-0882-407e-a71d-f86a3ca7a154 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:17.995271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:17.996646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:17.997220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:17.997597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:18.009952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:18.011271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 988/1960] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:17 2022] PUT /identity/v3/projects/653fa3ff8bb84850b7cf7e2e133fb240/users/0a6dde8a3e564a65a60191569421a8b8/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:18.017453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:18.022359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60153b1-d277-44a2-a0c9-adb1fb62da5d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:18.022653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60153b1-d277-44a2-a0c9-adb1fb62da5d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:18.022931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60153b1-d277-44a2-a0c9-adb1fb62da5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:18.039155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 973/1961] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:18.074487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a60153b1-d277-44a2-a0c9-adb1fb62da5d None None] MFA Rules not processed for user `0a6dde8a3e564a65a60191569421a8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:18.075770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a60153b1-d277-44a2-a0c9-adb1fb62da5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:18.089594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:18.178158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 989/1962] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:18.272199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:18.287510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec2377-ca28-45b6-b751-11ad1b3a4514 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:18.448581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:18.449305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:18.449660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:18.450026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:18.472231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:18.473908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:18.496251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 974/1963] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:19.109215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60153b1-d277-44a2-a0c9-adb1fb62da5d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:19.220475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60153b1-d277-44a2-a0c9-adb1fb62da5d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:19.227240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00587cf1c76d4d0e97b2f4b67881758a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae035c89a0334357ae4aec7a008b3c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:19.228391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:19.228832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:19.229445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:19.230394 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:19.230961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:19.233501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:19.267872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:19.277355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 990/1964] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:19.284419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e169be-54c3-4474-871d-ef21b5517aa5 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:19.305566 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00587cf1c76d4d0e97b2f4b67881758a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae035c89a0334357ae4aec7a008b3c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:19.306776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:19.307208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:19.307598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:19.308483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:19.316773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:19.354356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 975/1965] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:19 2022] POST /identity/v3/projects => generated 353 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:19.359099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:19.373263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331346a-7274-453b-ba0a-b7afc8c75632 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:19.491153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00587cf1c76d4d0e97b2f4b67881758a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae035c89a0334357ae4aec7a008b3c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:19.492176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:19.492643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:19.493190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:19.495356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:19.495913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:19.506191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:19.546503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 991/1966] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:19.605372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:19.623335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acac3e-d4bb-439b-a788-8f1183095947 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:19.637609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00587cf1c76d4d0e97b2f4b67881758a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae035c89a0334357ae4aec7a008b3c7a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:19.638231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:19.638571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:19.639016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] PATH_INFO: `/v3/projects/1debb77ea64b4d0688e57f6a84d671ba` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:19.642748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1debb77ea64b4d0688e57f6a84d671ba)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:19.646173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:19.791944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1debb77ea64b4d0688e57f6a84d671ba', 'request_id': 'req-0c27717c-c239-4b58-83ce-54d46e5d3bb4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:19.816933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1debb77ea64b4d0688e57f6a84d671ba', 'request_id': 'req-0c27717c-c239-4b58-83ce-54d46e5d3bb4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:19.840287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1debb77ea64b4d0688e57f6a84d671ba', 'request_id': 'req-0c27717c-c239-4b58-83ce-54d46e5d3bb4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:19.884486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] The token cache is being invalidate because project 1debb77ea64b4d0688e57f6a84d671ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:19.884791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:19.885542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0c27717c-c239-4b58-83ce-54d46e5d3bb4 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:19.890502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 976/1967] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:19 2022] DELETE /identity/v3/projects/1debb77ea64b4d0688e57f6a84d671ba => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:20.402076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:20.407486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:20.571776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:20.642337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596a7dc-03f4-4744-8413-dbee61ae9ed3 tempest-VolumeQuotaClassesTest-1834505745 tempest-VolumeQuotaClassesTest-1834505745-project-admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:20.838000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:20.840091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:20.840699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:20.841232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] PATH_INFO: `/v3/users/1e3eb4e29d5749b0af4e6ca6479b29e4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:20.843574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3eb4e29d5749b0af4e6ca6479b29e4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:20.847308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:20.948642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3eb4e29d5749b0af4e6ca6479b29e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:20.949417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3eb4e29d5749b0af4e6ca6479b29e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:20.950079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3eb4e29d5749b0af4e6ca6479b29e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:20.978600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3eb4e29d5749b0af4e6ca6479b29e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:21.019479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3eb4e29d5749b0af4e6ca6479b29e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:21.063339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 992/1968] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:20 2022] DELETE /identity/v3/users/1e3eb4e29d5749b0af4e6ca6479b29e4 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:21.076197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:21.078762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:21.079234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:21.115729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:21.118129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:21.124108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:21.125766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:21.171848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:21.238686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 977/1969] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:21.351593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f387e3e-95f1-4786-9974-4139679ccfd2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:21.365789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:21.367085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:21.367584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:21.368096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] PATH_INFO: `/v3/users/6ccdcfc23f7348eb80cb08281014c9e6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:21.374492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ccdcfc23f7348eb80cb08281014c9e6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:21.392075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:21.407580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:21.507559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:21.509384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:21.541858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ccdcfc23f7348eb80cb08281014c9e6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:21.543647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ccdcfc23f7348eb80cb08281014c9e6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:21.548419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ccdcfc23f7348eb80cb08281014c9e6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:21.582064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ccdcfc23f7348eb80cb08281014c9e6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:21.671885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb429-2acd-42a0-99e1-3eb4ac5dc1ec None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:21.676939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf659895-93ff-4a3e-8f59-273a7929e0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:21.678050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659895-93ff-4a3e-8f59-273a7929e0be service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:21.678625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659895-93ff-4a3e-8f59-273a7929e0be service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:21.679364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf659895-93ff-4a3e-8f59-273a7929e0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:21.684152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf659895-93ff-4a3e-8f59-273a7929e0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:21.686186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ccdcfc23f7348eb80cb08281014c9e6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:21.705989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf659895-93ff-4a3e-8f59-273a7929e0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:21.710458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf659895-93ff-4a3e-8f59-273a7929e0be service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:21.739354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 978/1970] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:21.746328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 993/1971] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:21 2022] DELETE /identity/v3/users/6ccdcfc23f7348eb80cb08281014c9e6 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:21.753915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:21.754685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:21.755111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:21.834420 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:21.840643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:22.073759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 979/1972] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:22.128607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:22.141956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:22.348623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ecfcb-0897-4e1d-a18d-69f284775570 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:22.367116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac678c4-6883-4d60-838d-69fc0488223d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:22.368331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac678c4-6883-4d60-838d-69fc0488223d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:22.368836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac678c4-6883-4d60-838d-69fc0488223d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:22.369321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac678c4-6883-4d60-838d-69fc0488223d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:22.402632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac678c4-6883-4d60-838d-69fc0488223d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:22.408807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac678c4-6883-4d60-838d-69fc0488223d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:22.439649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 994/1973] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:23.211185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:23.215366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:23.271204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ccceb-c681-4017-9272-39696b1aaee9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:23.293337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:23.295000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:23.296384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:23.296936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] PATH_INFO: `/v3/users/0a6dde8a3e564a65a60191569421a8b8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:23.299522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6dde8a3e564a65a60191569421a8b8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:23.302757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:23.391039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6dde8a3e564a65a60191569421a8b8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.391933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6dde8a3e564a65a60191569421a8b8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.392605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6dde8a3e564a65a60191569421a8b8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.404640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6dde8a3e564a65a60191569421a8b8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.434032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6dde8a3e564a65a60191569421a8b8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.437357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:23.457179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 980/1974] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:23 2022] DELETE /identity/v3/users/0a6dde8a3e564a65a60191569421a8b8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:23.462763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:23.463396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:23.463396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:23.506025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:23.507922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:23.611861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 995/1975] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:23.643233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:23.645254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:23.736397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:23.738389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:23.772893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4dc7e-ba31-41bc-952b-1fbb781cdf5f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:23.786984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:23.787958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:23.788281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:23.788565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] PATH_INFO: `/v3/projects/60c96e4c54934ebf98be61808603c0ea` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:23.790436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c96e4c54934ebf98be61808603c0ea)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:23.792735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:23.838743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:23.865838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f1df8-9048-4243-a140-1ad14739142a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:23.885926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c96e4c54934ebf98be61808603c0ea', 'request_id': 'req-f349198c-03b8-42c3-8337-21898bfcfec5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.902065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c96e4c54934ebf98be61808603c0ea', 'request_id': 'req-f349198c-03b8-42c3-8337-21898bfcfec5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.921443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c96e4c54934ebf98be61808603c0ea', 'request_id': 'req-f349198c-03b8-42c3-8337-21898bfcfec5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.944374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] The token cache is being invalidate because project 60c96e4c54934ebf98be61808603c0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:23.944969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.946510 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:23.953728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 996/1976] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:23 2022] DELETE /identity/v3/projects/60c96e4c54934ebf98be61808603c0ea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:23.954883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:23.956876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:23.974787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:23.975668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:23.975787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:23.976309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:23.978787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:24.054697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349198c-03b8-42c3-8337-21898bfcfec5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:24.063120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:24.063959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:24.064473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:24.064896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] PATH_INFO: `/v3/projects/6e271aa080ac4740b9b09f6f28eb2138` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:24.066584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e271aa080ac4740b9b09f6f28eb2138)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:24.068729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:24.125458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:24.127185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:24.146095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 981/1977] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:24.147530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:24.149986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:24.165377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f03f8d-5f05-4531-af48-77dcd6e1940c service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:24.199986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e271aa080ac4740b9b09f6f28eb2138', 'request_id': 'req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.219431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e271aa080ac4740b9b09f6f28eb2138', 'request_id': 'req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.238168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e271aa080ac4740b9b09f6f28eb2138', 'request_id': 'req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.272301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] The token cache is being invalidate because project 6e271aa080ac4740b9b09f6f28eb2138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:24.273508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.274325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.281979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 997/1978] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:23 2022] DELETE /identity/v3/projects/6e271aa080ac4740b9b09f6f28eb2138 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:24.283746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:24.288122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:24.295683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:24.315595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:24.316696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:24.318097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:24.318619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] PATH_INFO: `/v3/users/00587cf1c76d4d0e97b2f4b67881758a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:24.321295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00587cf1c76d4d0e97b2f4b67881758a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:24.324796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:24.434476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00587cf1c76d4d0e97b2f4b67881758a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.435192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00587cf1c76d4d0e97b2f4b67881758a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.436704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00587cf1c76d4d0e97b2f4b67881758a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.452775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00587cf1c76d4d0e97b2f4b67881758a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.480627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:24.484795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00587cf1c76d4d0e97b2f4b67881758a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.516261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 982/1979] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:24 2022] DELETE /identity/v3/users/00587cf1c76d4d0e97b2f4b67881758a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:24.570048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e7f57-3d2c-4fa5-89f4-0d67f6f2048f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:24.634250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:24.637121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:24.788603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:24.789639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:24.790167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:24.790679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] PATH_INFO: `/v3/users/c5d2a808965940bea8c39d3c7fc7326b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:24.792939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d2a808965940bea8c39d3c7fc7326b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:24.799138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:24.804824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8c680-9e81-42bb-8820-9663c29f0023 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:24.834631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:24.835382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:24.835727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:24.836049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] PATH_INFO: `/v3/projects/653fa3ff8bb84850b7cf7e2e133fb240` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:24.840955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=653fa3ff8bb84850b7cf7e2e133fb240)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:24.851029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:24.882376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d2a808965940bea8c39d3c7fc7326b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.883271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d2a808965940bea8c39d3c7fc7326b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.883896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d2a808965940bea8c39d3c7fc7326b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.932738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d2a808965940bea8c39d3c7fc7326b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.974688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d2a808965940bea8c39d3c7fc7326b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.988066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653fa3ff8bb84850b7cf7e2e133fb240', 'request_id': 'req-6803d1a8-d4fe-4dec-b32c-26eadac694b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:24.996517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653fa3ff8bb84850b7cf7e2e133fb240', 'request_id': 'req-6803d1a8-d4fe-4dec-b32c-26eadac694b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.008271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 998/1980] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:24 2022] DELETE /identity/v3/users/c5d2a808965940bea8c39d3c7fc7326b => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:25.019476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653fa3ff8bb84850b7cf7e2e133fb240', 'request_id': 'req-6803d1a8-d4fe-4dec-b32c-26eadac694b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.064481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] The token cache is being invalidate because project 653fa3ff8bb84850b7cf7e2e133fb240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:25.064724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.067502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.069905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 983/1981] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:24 2022] DELETE /identity/v3/projects/653fa3ff8bb84850b7cf7e2e133fb240 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:25.185624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:25.188569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:25.294090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:25.296120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:25.308439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:25.322248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82808c26-825a-40ef-a3d9-b7f85739a67d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:25.330902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:25.331703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:25.331988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:25.332290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] PATH_INFO: `/v3/users/647a9ee6a066455b8033b50edb43974a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:25.333768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=647a9ee6a066455b8033b50edb43974a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:25.335730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:25.350619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:25.427273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647a9ee6a066455b8033b50edb43974a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.428369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647a9ee6a066455b8033b50edb43974a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.429158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647a9ee6a066455b8033b50edb43974a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.442211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647a9ee6a066455b8033b50edb43974a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.465080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d07ebd89-9e80-4dc3-8fbd-04d982fe4f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647a9ee6a066455b8033b50edb43974a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.465840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803d1a8-d4fe-4dec-b32c-26eadac694b6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:25.475235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:25.475940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:25.476261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:25.476822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] PATH_INFO: `/v3/projects/ae035c89a0334357ae4aec7a008b3c7a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:25.477750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae035c89a0334357ae4aec7a008b3c7a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:25.479900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:25.491293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 999/1982] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:25 2022] DELETE /identity/v3/users/647a9ee6a066455b8033b50edb43974a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:25.497813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:25.498115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:25.498502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:25.548175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:25.550017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:25.583470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae035c89a0334357ae4aec7a008b3c7a', 'request_id': 'req-33089083-65a8-448d-b46e-210dde57e3c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.598739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae035c89a0334357ae4aec7a008b3c7a', 'request_id': 'req-33089083-65a8-448d-b46e-210dde57e3c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.614440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae035c89a0334357ae4aec7a008b3c7a', 'request_id': 'req-33089083-65a8-448d-b46e-210dde57e3c8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.676406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] The token cache is being invalidate because project ae035c89a0334357ae4aec7a008b3c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:25.678008 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.679881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-33089083-65a8-448d-b46e-210dde57e3c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:25.688967 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 984/1983] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:25 2022] DELETE /identity/v3/projects/ae035c89a0334357ae4aec7a008b3c7a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:25.693107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d506c-f1e6-4d87-84b8-13ec3dbd23cf None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:25.693400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d506c-f1e6-4d87-84b8-13ec3dbd23cf None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:25.693678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d506c-f1e6-4d87-84b8-13ec3dbd23cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:25.730571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-732d506c-f1e6-4d87-84b8-13ec3dbd23cf None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:25.731828 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-732d506c-f1e6-4d87-84b8-13ec3dbd23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:25.765409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1000/1984] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:25.828584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:25.830992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:25.911579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 985/1985] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:25.920082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:25.921218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:25.921725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:25.975507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:25.976769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:25.998563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 986/1986] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:26.000126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ab592-7d2e-4154-9a65-6ca5bfdb47cf None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.000745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.003642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:26.028525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5781e8-2f92-4323-a117-69188af33855 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.043759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.044581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.046588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.047034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] PATH_INFO: `/v3/projects/5afc8c8189ab41ee98d9c8c0b5848d15` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.050846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afc8c8189ab41ee98d9c8c0b5848d15)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.057141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.074771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:26.100744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.101432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.101715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.101996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.121312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.122787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.139571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:26.149141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1001/1987] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:26.149724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.168449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afc8c8189ab41ee98d9c8c0b5848d15', 'request_id': 'req-200b1d74-5b08-436e-a952-0b13b666d792'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.172629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d7406-1938-4b3c-a145-4c1aec10fdb4 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.180737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afc8c8189ab41ee98d9c8c0b5848d15', 'request_id': 'req-200b1d74-5b08-436e-a952-0b13b666d792'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.195514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afc8c8189ab41ee98d9c8c0b5848d15', 'request_id': 'req-200b1d74-5b08-436e-a952-0b13b666d792'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.224380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] The token cache is being invalidate because project 5afc8c8189ab41ee98d9c8c0b5848d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:26.224795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.225889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.228120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 987/1988] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:25 2022] DELETE /identity/v3/projects/5afc8c8189ab41ee98d9c8c0b5848d15 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:26.231781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.235111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:26.294195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.295402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.296544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.297683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.298741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:26.299289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.303623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.325890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1002/1989] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:26.329981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.332034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:26.350390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306039-7b26-41c0-a545-fa862e43c969 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.356053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.357162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.357162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.357488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.359201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.361329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.378322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b1d74-5b08-436e-a952-0b13b666d792 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.392928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.394812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.395198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.395610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] PATH_INFO: `/v3/users/aac97f34593c45eeae3c2f2a3836f47e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.397399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac97f34593c45eeae3c2f2a3836f47e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.399823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.406600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1003/1990] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:26 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:26.412422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.528319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac97f34593c45eeae3c2f2a3836f47e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.529094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac97f34593c45eeae3c2f2a3836f47e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.535790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e0e29-94f8-479d-b3e0-52c510ef756b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.537319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac97f34593c45eeae3c2f2a3836f47e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.550532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac97f34593c45eeae3c2f2a3836f47e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.554553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.555420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.555883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.556384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.558854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.562997 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.567052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac97f34593c45eeae3c2f2a3836f47e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:26.588446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 988/1991] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:26 2022] DELETE /identity/v3/users/aac97f34593c45eeae3c2f2a3836f47e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:26.595921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1004/1992] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:26 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:26.601070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.602866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:26.677440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:26.744173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dc7be-6be0-4d37-ae04-72373cacc2e2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.760567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.761226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.761511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.761838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.762584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.764907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.783910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 989/1993] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:26.788639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.804880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e50bc0-9881-4d71-9ba0-1d789530df97 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.845500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78600532-c271-4cd4-a0ef-1447a2c0e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.848326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78600532-c271-4cd4-a0ef-1447a2c0e8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.848326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78600532-c271-4cd4-a0ef-1447a2c0e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.848541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78600532-c271-4cd4-a0ef-1447a2c0e8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.849137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78600532-c271-4cd4-a0ef-1447a2c0e8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.852053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78600532-c271-4cd4-a0ef-1447a2c0e8a9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.889201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1005/1994] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:26.894227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:26.908265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ca2c-1d1c-4c6f-83bd-65b8ae2ce4c7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:26.913568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:26.914238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.914517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.914873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] PATH_INFO: `/v3/projects/697832ddfe9340718db1124e8201f324/users/1b54d9ecbe534ba2b63e24277c5a85e9/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:26.933906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697832ddfe9340718db1124e8201f324, user_id=1b54d9ecbe534ba2b63e24277c5a85e9, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:26.937348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:26.956466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 990/1995] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:26 2022] PUT /identity/v3/projects/697832ddfe9340718db1124e8201f324/users/1b54d9ecbe534ba2b63e24277c5a85e9/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:26.967584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a8a5-ecde-487b-ac8c-259e4af04fd8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:26.967869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a8a5-ecde-487b-ac8c-259e4af04fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:26.968306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a8a5-ecde-487b-ac8c-259e4af04fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.022160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9795a8a5-ecde-487b-ac8c-259e4af04fd8 None None] MFA Rules not processed for user `1b54d9ecbe534ba2b63e24277c5a85e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:27.023615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9795a8a5-ecde-487b-ac8c-259e4af04fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.071600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.075233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.086817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:27.171843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1006/1996] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:27.172764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a8a5-ecde-487b-ac8c-259e4af04fd8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.223556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a5a93-8e33-4f78-b419-c6296e20bc11 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.228997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.229606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.229892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.230165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] PATH_INFO: `/v3/projects/ec975d8c1db54365b1945d89faee7ccd` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.231349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec975d8c1db54365b1945d89faee7ccd)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.234256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.256714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a8a5-ecde-487b-ac8c-259e4af04fd8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.261746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.262736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.263015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.263284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.264663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.266986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.294002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec975d8c1db54365b1945d89faee7ccd', 'request_id': 'req-d93f592c-9905-43cd-a095-1634cc38102a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.301701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec975d8c1db54365b1945d89faee7ccd', 'request_id': 'req-d93f592c-9905-43cd-a095-1634cc38102a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.304753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1007/1997] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:27 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:27.305805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.308800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.316400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec975d8c1db54365b1945d89faee7ccd', 'request_id': 'req-d93f592c-9905-43cd-a095-1634cc38102a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.336985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] The token cache is being invalidate because project ec975d8c1db54365b1945d89faee7ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:27.337316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.338360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.345976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 991/1998] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:27 2022] DELETE /identity/v3/projects/ec975d8c1db54365b1945d89faee7ccd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:27.347797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.351202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.391651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d604ea-4e9d-4d6f-964d-84345376be89 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.399419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.400421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.400804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.406121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] PATH_INFO: `/v3/projects/853fa4514d59413794ecec3488ef2f6a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.406121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=853fa4514d59413794ecec3488ef2f6a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.406121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.407641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:27.454205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f592c-9905-43cd-a095-1634cc38102a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.478566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853fa4514d59413794ecec3488ef2f6a', 'request_id': 'req-1ab88195-f756-4773-9b7a-49080a9c7b82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.490229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853fa4514d59413794ecec3488ef2f6a', 'request_id': 'req-1ab88195-f756-4773-9b7a-49080a9c7b82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.493047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:27.504273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853fa4514d59413794ecec3488ef2f6a', 'request_id': 'req-1ab88195-f756-4773-9b7a-49080a9c7b82'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.522440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] The token cache is being invalidate because project 853fa4514d59413794ecec3488ef2f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:27.522738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.523465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.525173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1008/1999] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:27 2022] DELETE /identity/v3/projects/853fa4514d59413794ecec3488ef2f6a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:27.526108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.527404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.530914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880c5d3-b3b0-40e8-bd17-b46bbc2c4ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.531989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c5d3-b3b0-40e8-bd17-b46bbc2c4ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.532572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c5d3-b3b0-40e8-bd17-b46bbc2c4ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.533123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880c5d3-b3b0-40e8-bd17-b46bbc2c4ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.534202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c5d3-b3b0-40e8-bd17-b46bbc2c4ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.537558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880c5d3-b3b0-40e8-bd17-b46bbc2c4ed4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.541721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab88195-f756-4773-9b7a-49080a9c7b82 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.553744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.554761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.555077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.556196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] PATH_INFO: `/v3/users/02d1f97d119f43e59be12564dbaf200f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.556723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d1f97d119f43e59be12564dbaf200f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.560306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.565187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 992/2000] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:27 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:27.567085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.567665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.568355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.589894 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:27.591126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.601002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 993/2001] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:27.601926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.603215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.616703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddf8d0-220a-4da4-a155-bb78dccdeef1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.621585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbb083-896c-46a5-b999-219dac1c4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.622200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb083-896c-46a5-b999-219dac1c4c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.622580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb083-896c-46a5-b999-219dac1c4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.622766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbb083-896c-46a5-b999-219dac1c4c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.624160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbb083-896c-46a5-b999-219dac1c4c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.626068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bbb083-896c-46a5-b999-219dac1c4c65 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.640080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 994/2002] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:27.640080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.640080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.640080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.643121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d1f97d119f43e59be12564dbaf200f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.644109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d1f97d119f43e59be12564dbaf200f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.645102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d1f97d119f43e59be12564dbaf200f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.654756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d1f97d119f43e59be12564dbaf200f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.660656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:27.661868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.666498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d1f97d119f43e59be12564dbaf200f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:27.671064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 995/2003] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:27.671959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.673426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.687575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcadeaa-f3c4-479a-9b46-1a63feb9c7dc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.691688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1009/2004] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:27 2022] DELETE /identity/v3/users/02d1f97d119f43e59be12564dbaf200f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:27.692866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.693485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.693816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.694029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.694671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.696425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.696601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.711223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 996/2005] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:27.715956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.731136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e1a04-297b-4d65-a4f1-973faee302ac admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.813531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1025b-1d6c-4d62-bdfd-307b77a03c23 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.821937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.823027 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.823560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.824125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.825311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:27.825902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.828772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.847191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1010/2006] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:27.852090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61582082-ad4a-4464-ac5b-22172d37017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.853224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.853451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582082-ad4a-4464-ac5b-22172d37017f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.853588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582082-ad4a-4464-ac5b-22172d37017f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.854030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582082-ad4a-4464-ac5b-22172d37017f admin admin] PATH_INFO: `/v3/projects/132e2f411bb54812bd263ebad99d4a20/users/413797ffbef34e88918c1d4aab341f0c/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.872114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256dd06a-d6d5-49c9-aa5a-c8b280c1268f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:27.878457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:27.879096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.879378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.879653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.880723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.882535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.888497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61582082-ad4a-4464-ac5b-22172d37017f admin admin] RBAC: Authorizing `identity:create_grant(project_id=132e2f411bb54812bd263ebad99d4a20, user_id=413797ffbef34e88918c1d4aab341f0c, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:27.892993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61582082-ad4a-4464-ac5b-22172d37017f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:27.916134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 997/2007] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:27 2022] PUT /identity/v3/projects/132e2f411bb54812bd263ebad99d4a20/users/413797ffbef34e88918c1d4aab341f0c/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:27.930290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1011/2008] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:27 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:27.931170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba42d-e441-4f78-af87-386333148745 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:27.931522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba42d-e441-4f78-af87-386333148745 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:27.931803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aba42d-e441-4f78-af87-386333148745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:27.935463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:27.975635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e3aba42d-e441-4f78-af87-386333148745 None None] MFA Rules not processed for user `413797ffbef34e88918c1d4aab341f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:27.976842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=3,keystone:DELETE=13,keystone:SELECT=84 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:27.977449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e3aba42d-e441-4f78-af87-386333148745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:27.990453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:28.047704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb0edb-7166-41b7-ad28-8f241a9b9063 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.057017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.057796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.058219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.064225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.065028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.068442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.110048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 998/2009] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:28.111583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba42d-e441-4f78-af87-386333148745 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.113208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e3aba42d-e441-4f78-af87-386333148745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.133017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1012/2010] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:27 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:28.133613 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aba42d-e441-4f78-af87-386333148745 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.135258 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.142515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.143777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.144261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.144680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] PATH_INFO: `/v3/projects/4780ae2d003740eab2796c1fc3d31e48` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.146132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4780ae2d003740eab2796c1fc3d31e48)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.148193 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.151903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40570fd3-8d3e-44e4-bcc0-86700c368e4a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.159503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.160204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.160488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.160762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.162543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.165092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.201058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1013/2011] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:28.202076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.222563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4780ae2d003740eab2796c1fc3d31e48', 'request_id': 'req-b8e26e16-fccf-4ee1-a766-1707c598b55f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:28.230250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4780ae2d003740eab2796c1fc3d31e48', 'request_id': 'req-b8e26e16-fccf-4ee1-a766-1707c598b55f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:28.240258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4780ae2d003740eab2796c1fc3d31e48', 'request_id': 'req-b8e26e16-fccf-4ee1-a766-1707c598b55f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:28.256411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] The token cache is being invalidate because project 4780ae2d003740eab2796c1fc3d31e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:28.256953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:28.260573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:28.262929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 999/2012] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:28 2022] DELETE /identity/v3/projects/4780ae2d003740eab2796c1fc3d31e48 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:28.263946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.267729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.279790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26daf68a-98f7-4362-aabf-d5e9442a3d87 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.337786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26e16-fccf-4ee1-a766-1707c598b55f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.341283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869aba1-3685-4be6-b130-38178b8233ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.342252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869aba1-3685-4be6-b130-38178b8233ac admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.342524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869aba1-3685-4be6-b130-38178b8233ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.342873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869aba1-3685-4be6-b130-38178b8233ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.343320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.343587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869aba1-3685-4be6-b130-38178b8233ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.344582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.344856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.345149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.345257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869aba1-3685-4be6-b130-38178b8233ac admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.345765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.347722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.356261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1014/2013] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:28.358598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9cc02-1e43-49be-ae79-87783e76f82a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.358883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9cc02-1e43-49be-ae79-87783e76f82a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.359154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9cc02-1e43-49be-ae79-87783e76f82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.382187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1000/2014] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:28.383076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.384869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.391796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-17d9cc02-1e43-49be-ae79-87783e76f82a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:28.393996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-17d9cc02-1e43-49be-ae79-87783e76f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.407674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2617880-1b1b-401c-861f-32a54d636563 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.408357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1015/2015] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:28.409520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9cc02-1e43-49be-ae79-87783e76f82a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.420996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1697ac-eefd-4bbb-8840-dfd57f69eac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.421812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1697ac-eefd-4bbb-8840-dfd57f69eac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.422290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1697ac-eefd-4bbb-8840-dfd57f69eac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.422705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1697ac-eefd-4bbb-8840-dfd57f69eac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.423437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1697ac-eefd-4bbb-8840-dfd57f69eac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.425345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1697ac-eefd-4bbb-8840-dfd57f69eac1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.426692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9cc02-1e43-49be-ae79-87783e76f82a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.432435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.433144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.433500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.433855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.434715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.436675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.437402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1001/2016] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:28.441172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2010cf-9170-44e6-b00e-a30f0deba951 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.441172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2010cf-9170-44e6-b00e-a30f0deba951 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.441172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2010cf-9170-44e6-b00e-a30f0deba951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.454446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1016/2017] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:28.454446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.459053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2e2010cf-9170-44e6-b00e-a30f0deba951 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:28.460293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2e2010cf-9170-44e6-b00e-a30f0deba951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.463318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4f668-a95d-4bf5-9cc2-dbf57dbb16d5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.468623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.468946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1002/2018] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:28.469820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.470108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.470389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] PATH_INFO: `/v3/projects/1cb990610b5841d6af0d15167963c239/users/10b8ab0221404e5cb8b918617e156e8b/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.470562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2010cf-9170-44e6-b00e-a30f0deba951 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.478013 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:28.482831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2010cf-9170-44e6-b00e-a30f0deba951 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.490201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb990610b5841d6af0d15167963c239, user_id=10b8ab0221404e5cb8b918617e156e8b, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.491458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f361a-d5e0-4890-a4db-373c2883c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.492179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f361a-d5e0-4890-a4db-373c2883c258 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.492804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.492924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f361a-d5e0-4890-a4db-373c2883c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.493076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f361a-d5e0-4890-a4db-373c2883c258 admin admin] PATH_INFO: `/v3/projects/72ed6e1a91994393b364284bec6a1907/users/2549eebf50a24f0192fe9178b84c6321/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.495971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:28.509534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1017/2019] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:28 2022] PUT /identity/v3/projects/1cb990610b5841d6af0d15167963c239/users/10b8ab0221404e5cb8b918617e156e8b/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:28.510554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f361a-d5e0-4890-a4db-373c2883c258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ed6e1a91994393b364284bec6a1907, user_id=2549eebf50a24f0192fe9178b84c6321, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.510698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.513410 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f361a-d5e0-4890-a4db-373c2883c258 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.528738 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1003/2020] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:28 2022] PUT /identity/v3/projects/72ed6e1a91994393b364284bec6a1907/users/2549eebf50a24f0192fe9178b84c6321/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:28.531459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac85e-90aa-4e48-9b8a-f219c1cb6d24 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.531905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac85e-90aa-4e48-9b8a-f219c1cb6d24 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.532210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eac85e-90aa-4e48-9b8a-f219c1cb6d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.552168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-98eac85e-90aa-4e48-9b8a-f219c1cb6d24 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:28.553375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-98eac85e-90aa-4e48-9b8a-f219c1cb6d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.579034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf818e5-a30a-42c4-82ee-8477548e0f08 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.618228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1004/2021] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:28.619683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac85e-90aa-4e48-9b8a-f219c1cb6d24 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.631178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eac85e-90aa-4e48-9b8a-f219c1cb6d24 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.636285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.636907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.637184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.637452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.638218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.641271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.653185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1005/2022] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:28.654201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.654887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.655167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.655443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.656132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:28.656603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.657248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.658054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.659111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.671018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1018/2023] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:28.671902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.681664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f2404-5eb0-42cf-b5c3-0019e490f9ba admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.687890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.688594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.688901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.689178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] PATH_INFO: `/v3/projects/72ed6e1a91994393b364284bec6a1907/users/2549eebf50a24f0192fe9178b84c6321/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.691096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ed6e1a91994393b364284bec6a1907, user_id=2549eebf50a24f0192fe9178b84c6321, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.693772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.707416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1019/2024] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:28 2022] PUT /identity/v3/projects/72ed6e1a91994393b364284bec6a1907/users/2549eebf50a24f0192fe9178b84c6321/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:28.708337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.735181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7bbd-4c09-4a82-bf10-e0d0d252a9f5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.788259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5abf-0123-40a3-8a97-a1dd93b2852e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.793138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f42248-9317-4583-bb85-fa2eb485591e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.794006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f42248-9317-4583-bb85-fa2eb485591e service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.794415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f42248-9317-4583-bb85-fa2eb485591e service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.794606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.794889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f42248-9317-4583-bb85-fa2eb485591e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.795259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.795958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.796171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.796913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.799063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.809296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f42248-9317-4583-bb85-fa2eb485591e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.812150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f42248-9317-4583-bb85-fa2eb485591e service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.824038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1006/2025] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:28.825386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.825758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.826045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.832469 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1020/2026] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:28.836523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.851647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:28.869563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] MFA Rules not processed for user `2549eebf50a24f0192fe9178b84c6321`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:28.871149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.894101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:28.944000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913fc866-af18-4380-b91c-2b85e2b842ee admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:28.950153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:28.950870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:28.952095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:28.953007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:28.953965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:28.956162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:28.972590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1007/2027] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:28.988469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:28.993315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1021/2028] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:28 2022] POST /identity/v3/users => generated 283 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:28.993515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:28.995923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.015345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979d9b7-1471-4258-ac33-3c40c1661473 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.024394 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.025728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.027199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.027733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.028983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.031737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.061602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1022/2029] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:29.063706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.079576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae129c3-93ee-42c0-87d5-5d48c36388a9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.085252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30e35a-2320-481f-a17d-a23156875457 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.086508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.087626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.088048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.088496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.093463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.094241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.094727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.095703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.096726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.099874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.100733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.102185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.116170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1023/2030] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:29.121448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.132871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1008/2031] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:29.135011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff956ed8-151d-457a-9806-b42abc566bd8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.141837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4270c-e59d-46ed-a452-c327b01d288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.142658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4270c-e59d-46ed-a452-c327b01d288d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.143741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4270c-e59d-46ed-a452-c327b01d288d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.143741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4270c-e59d-46ed-a452-c327b01d288d admin admin] PATH_INFO: `/v3/projects/d8aaab5771104eacbca5980002b6a4f6/users/e6018cbd9352458bbaed11782fa9ba75/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.183613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4270c-e59d-46ed-a452-c327b01d288d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8aaab5771104eacbca5980002b6a4f6, user_id=e6018cbd9352458bbaed11782fa9ba75, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.189235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4270c-e59d-46ed-a452-c327b01d288d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.206362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.208724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:29.210305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1024/2032] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:29 2022] PUT /identity/v3/projects/d8aaab5771104eacbca5980002b6a4f6/users/e6018cbd9352458bbaed11782fa9ba75/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:29.228102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd5db-098e-472a-91e0-4c76f2cce435 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.228390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd5db-098e-472a-91e0-4c76f2cce435 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.228668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffd5db-098e-472a-91e0-4c76f2cce435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.235903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16da98-4e03-4765-86df-0ba1a96188ff service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.287484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1dffd5db-098e-472a-91e0-4c76f2cce435 None None] MFA Rules not processed for user `e6018cbd9352458bbaed11782fa9ba75`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:29.289097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1dffd5db-098e-472a-91e0-4c76f2cce435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:29.359185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.360216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.360672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.361138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.372338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:29.466938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1025/2033] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:29.473894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffd5db-098e-472a-91e0-4c76f2cce435 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.550967 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.553814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.555332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:29.573318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1009/2034] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:29.596404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffd5db-098e-472a-91e0-4c76f2cce435 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.601718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.602413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.602761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.603113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.603826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.606692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.683015 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1026/2035] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:29 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:29.687653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.708777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d876df-a62d-4d31-b436-20569a68e8a8 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.727345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:29.829014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390019a-9bf1-426a-abd3-4b5e4e720c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.830805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390019a-9bf1-426a-abd3-4b5e4e720c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.831282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390019a-9bf1-426a-abd3-4b5e4e720c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.832369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390019a-9bf1-426a-abd3-4b5e4e720c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.834160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390019a-9bf1-426a-abd3-4b5e4e720c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.836916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390019a-9bf1-426a-abd3-4b5e4e720c41 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.883826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1010/2036] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:29 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:29.887511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.906553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8799fa-2753-4392-9eb6-f40983ebc417 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.908357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965964d7-2329-43b7-b139-a73fa270b2ec None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.909103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965964d7-2329-43b7-b139-a73fa270b2ec None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.910085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965964d7-2329-43b7-b139-a73fa270b2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.922315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.922949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.923231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.923507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:29.928754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:29.930040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:29.953580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1027/2037] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:29.960420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:29.975035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-965964d7-2329-43b7-b139-a73fa270b2ec None None] MFA Rules not processed for user `10b8ab0221404e5cb8b918617e156e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:29.977540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-965964d7-2329-43b7-b139-a73fa270b2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:29.987921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea891ade-a949-4322-8d19-bc913be32582 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:29.994303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:29.995325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:29.995737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:29.996207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] PATH_INFO: `/v3/projects/ef0a1ea8e9c640d2807171cbc052917e/users/7457da3ac41e4effb89d48f90f098464/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:30.027506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0a1ea8e9c640d2807171cbc052917e, user_id=7457da3ac41e4effb89d48f90f098464, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:30.031486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:30.058227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1028/2038] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:29 2022] PUT /identity/v3/projects/ef0a1ea8e9c640d2807171cbc052917e/users/7457da3ac41e4effb89d48f90f098464/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:30.064836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:30.148039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1011/2039] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:30.166476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965964d7-2329-43b7-b139-a73fa270b2ec None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:30.235692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdbf6-a930-443b-afca-2be764b8189a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:30.254788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:30.255790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:30.256267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:30.256716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:30.257808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:30.262464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:30.293096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1029/2040] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:30.296755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:30.300508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965964d7-2329-43b7-b139-a73fa270b2ec None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:30.319457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e59d8-0492-4888-8031-92941c7466c7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:30.331691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a302c-0821-44d8-9c90-3c1a2fce9277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:30.332775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a302c-0821-44d8-9c90-3c1a2fce9277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:30.333238 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a302c-0821-44d8-9c90-3c1a2fce9277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:30.333663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a302c-0821-44d8-9c90-3c1a2fce9277 admin admin] PATH_INFO: `/v3/projects/ef0a1ea8e9c640d2807171cbc052917e/users/7457da3ac41e4effb89d48f90f098464/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:30.336755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a302c-0821-44d8-9c90-3c1a2fce9277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0a1ea8e9c640d2807171cbc052917e, user_id=7457da3ac41e4effb89d48f90f098464, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:30.341702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a302c-0821-44d8-9c90-3c1a2fce9277 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:30.364073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1030/2041] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:30 2022] PUT /identity/v3/projects/ef0a1ea8e9c640d2807171cbc052917e/users/7457da3ac41e4effb89d48f90f098464/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:30.377125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8f96-d29c-4635-999a-1a71b8ef535d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:30.377638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8f96-d29c-4635-999a-1a71b8ef535d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:30.377947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8f96-d29c-4635-999a-1a71b8ef535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:30.387631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:30.396675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:30.397727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:30.398517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:30.399050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:30.421723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ab8d8f96-d29c-4635-999a-1a71b8ef535d None None] MFA Rules not processed for user `7457da3ac41e4effb89d48f90f098464`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:30.423313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ab8d8f96-d29c-4635-999a-1a71b8ef535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:30.477428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:30.479438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:30.490017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1012/2042] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:30.511649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:30.520124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1031/2043] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:30.531842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:30.547712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66334e5a-4e36-4772-bed6-71f57879011f service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:30.609377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10156bd-b8af-4a53-bb41-63bad24c76e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:30.610780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10156bd-b8af-4a53-bb41-63bad24c76e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:30.611065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10156bd-b8af-4a53-bb41-63bad24c76e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:30.611370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10156bd-b8af-4a53-bb41-63bad24c76e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:30.626974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10156bd-b8af-4a53-bb41-63bad24c76e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:30.632189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10156bd-b8af-4a53-bb41-63bad24c76e4 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:30.648787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1013/2044] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:30.723668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8f96-d29c-4635-999a-1a71b8ef535d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:30.742037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8f96-d29c-4635-999a-1a71b8ef535d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:30.747364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:30.749087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:30.750061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:30.750478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:30.833737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:30.837764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:30.850919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1032/2045] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:31.978228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3ad2-fbc0-4690-af9d-a51af88f8ec7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:31.979204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3ad2-fbc0-4690-af9d-a51af88f8ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:31.979470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a3ad2-fbc0-4690-af9d-a51af88f8ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:32.002153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8f7a3ad2-fbc0-4690-af9d-a51af88f8ec7 None None] MFA Rules not processed for user `10b8ab0221404e5cb8b918617e156e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:32.003453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8f7a3ad2-fbc0-4690-af9d-a51af88f8ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:32.087984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1014/2046] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:33.130825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:33.271713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f23142-866d-43b0-84f1-786536ea1e99 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:33.276814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:33.277466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:33.278183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:33.278364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] PATH_INFO: `/v3/users/1b54d9ecbe534ba2b63e24277c5a85e9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:33.280633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b54d9ecbe534ba2b63e24277c5a85e9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:33.282669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:33.365584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b54d9ecbe534ba2b63e24277c5a85e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:33.366496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b54d9ecbe534ba2b63e24277c5a85e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:33.367243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b54d9ecbe534ba2b63e24277c5a85e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:33.379725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b54d9ecbe534ba2b63e24277c5a85e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:33.399907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b54d9ecbe534ba2b63e24277c5a85e9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:33.426230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1033/2047] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:33 2022] DELETE /identity/v3/users/1b54d9ecbe534ba2b63e24277c5a85e9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:33.431090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:33.431901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:33.431901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:33.458123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:33.460359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:33.554817 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:33.579451 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1015/2048] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:33.594170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:33.595778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:33.647357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:33.727857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f4347-4f25-4f06-b46d-b9ba99e11c1c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:33.736194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:33.737363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:33.738041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:33.738429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:33.762035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:33.765793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:33.799348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1034/2049] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:34.455612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:34.457154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:34.475502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8619b571-b4d8-48e4-9201-189052ecaac0 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:34.486022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:34.487625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:34.489396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:34.490640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] PATH_INFO: `/v3/projects/697832ddfe9340718db1124e8201f324` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:34.492581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697832ddfe9340718db1124e8201f324)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:34.495054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:34.606585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697832ddfe9340718db1124e8201f324', 'request_id': 'req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.626124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697832ddfe9340718db1124e8201f324', 'request_id': 'req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.643056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697832ddfe9340718db1124e8201f324', 'request_id': 'req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.682381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] The token cache is being invalidate because project 697832ddfe9340718db1124e8201f324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:34.683090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.684537 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.687983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1016/2050] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:34 2022] DELETE /identity/v3/projects/697832ddfe9340718db1124e8201f324 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:34.693494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:34.706151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f7cae-ea29-4c5d-9879-72f533b04a60 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:34.810444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:34.814018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:34.814866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:34.816720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] PATH_INFO: `/v3/users/413797ffbef34e88918c1d4aab341f0c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:34.819383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=413797ffbef34e88918c1d4aab341f0c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:34.822760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:34.931918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413797ffbef34e88918c1d4aab341f0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.932786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413797ffbef34e88918c1d4aab341f0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.933594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413797ffbef34e88918c1d4aab341f0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.949740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413797ffbef34e88918c1d4aab341f0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:34.985624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c332a80b-2ed9-4257-859f-92fdf41c4539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413797ffbef34e88918c1d4aab341f0c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:35.025254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1035/2051] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:34 2022] DELETE /identity/v3/users/413797ffbef34e88918c1d4aab341f0c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:35.472922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:35.475157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:35.502638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4136ec2-71d1-4ad3-9910-a9986b5e1b42 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:35.655523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:35.656278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:35.663072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:35.663354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] PATH_INFO: `/v3/users/e6018cbd9352458bbaed11782fa9ba75` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:35.671722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6018cbd9352458bbaed11782fa9ba75)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:35.674146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:35.808564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6018cbd9352458bbaed11782fa9ba75'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:35.809582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6018cbd9352458bbaed11782fa9ba75'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:35.810352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6018cbd9352458bbaed11782fa9ba75'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:35.822959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6018cbd9352458bbaed11782fa9ba75'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:35.854483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6018cbd9352458bbaed11782fa9ba75'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:35.856555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:35.880428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1017/2052] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:35 2022] DELETE /identity/v3/users/e6018cbd9352458bbaed11782fa9ba75 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:35.884704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:35.885338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:35.885552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:35.922642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:35.924047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:36.006692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:36.008842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:36.015336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:36.119281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1036/2053] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:36.164496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:36.166093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:36.205541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f4aaa-e6a4-4841-9bad-755c83a6acba admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:36.212368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:36.213811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:36.215404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:36.215404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] PATH_INFO: `/v3/projects/132e2f411bb54812bd263ebad99d4a20` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:36.218036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=132e2f411bb54812bd263ebad99d4a20)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:36.221213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:36.290570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20415340-5c91-4884-b26f-fd13aa87381e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:36.319640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132e2f411bb54812bd263ebad99d4a20', 'request_id': 'req-792bef25-7e51-4e5b-8b26-c19cb07904dc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.330620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132e2f411bb54812bd263ebad99d4a20', 'request_id': 'req-792bef25-7e51-4e5b-8b26-c19cb07904dc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.354436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132e2f411bb54812bd263ebad99d4a20', 'request_id': 'req-792bef25-7e51-4e5b-8b26-c19cb07904dc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.374129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] The token cache is being invalidate because project 132e2f411bb54812bd263ebad99d4a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:36.374587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.376381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.379472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1018/2054] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:36 2022] DELETE /identity/v3/projects/132e2f411bb54812bd263ebad99d4a20 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:36.383733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:36.386847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:36.393316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acf4f4-3f7d-4c53-8d23-bb195a9a8db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:36.394608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf4f4-3f7d-4c53-8d23-bb195a9a8db7 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:36.395239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf4f4-3f7d-4c53-8d23-bb195a9a8db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:36.396057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acf4f4-3f7d-4c53-8d23-bb195a9a8db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:36.399075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d1acf4f4-3f7d-4c53-8d23-bb195a9a8db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:36.549131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acf4f4-3f7d-4c53-8d23-bb195a9a8db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:36.550984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acf4f4-3f7d-4c53-8d23-bb195a9a8db7 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:36.570776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1037/2055] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:36.571204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bef25-7e51-4e5b-8b26-c19cb07904dc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:36.581470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:36.582749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:36.583515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:36.583975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] PATH_INFO: `/v3/users/2549eebf50a24f0192fe9178b84c6321` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:36.585605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2549eebf50a24f0192fe9178b84c6321)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:36.588291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:36.642931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:36.693395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2549eebf50a24f0192fe9178b84c6321'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.694883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2549eebf50a24f0192fe9178b84c6321'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.695678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2549eebf50a24f0192fe9178b84c6321'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.711515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2549eebf50a24f0192fe9178b84c6321'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.733584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-495448c9-aa13-4601-b002-bb80a3d28841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2549eebf50a24f0192fe9178b84c6321'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:36.763316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1019/2056] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:36 2022] DELETE /identity/v3/users/2549eebf50a24f0192fe9178b84c6321 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:36.876764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdec43-98f2-4636-8015-e88b2c2cf454 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:36.877277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdec43-98f2-4636-8015-e88b2c2cf454 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:36.877771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdec43-98f2-4636-8015-e88b2c2cf454 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:36.880593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1038/2057] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:02:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:02:36.953516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c8ea7-201a-47c0-904a-ba0f33c0f709 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:36.954654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c8ea7-201a-47c0-904a-ba0f33c0f709 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:36.955072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c8ea7-201a-47c0-904a-ba0f33c0f709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:36.985695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-188c8ea7-201a-47c0-904a-ba0f33c0f709 None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:36.987794 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-188c8ea7-201a-47c0-904a-ba0f33c0f709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:37.090412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1020/2058] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:37.102024 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdec43-98f2-4636-8015-e88b2c2cf454 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:37.103771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-46cdec43-98f2-4636-8015-e88b2c2cf454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:37.150321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d7be-14f0-4bfc-ab30-9af0aec81df5 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:37.150618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d7be-14f0-4bfc-ab30-9af0aec81df5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:37.150877 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d7be-14f0-4bfc-ab30-9af0aec81df5 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:37.152660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1021/2059] 10.222.0.50 () {54 vars in 961 bytes} [Wed Sep 14 13:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:02:37.171376 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c5d1-ab6f-41c5-a7bc-341906f41628 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:37.171667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c5d1-ab6f-41c5-a7bc-341906f41628 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:37.171927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151c5d1-ab6f-41c5-a7bc-341906f41628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:37.209885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:37.210532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d151c5d1-ab6f-41c5-a7bc-341906f41628 None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:37.211895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d151c5d1-ab6f-41c5-a7bc-341906f41628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:37.235540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1022/2060] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Sep 14 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:37.250173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdec43-98f2-4636-8015-e88b2c2cf454 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:37.257811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c5d1-ab6f-41c5-a7bc-341906f41628 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:37.272616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151c5d1-ab6f-41c5-a7bc-341906f41628 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:37.274414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:37.275303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:37.275584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:37.275863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] PATH_INFO: `/v3/users/805b09cc83c34399992003295c5a6e9e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:37.278669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805b09cc83c34399992003295c5a6e9e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:37.285699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:37.295487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:37.296607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:37.296892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:37.297317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:37.310229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:37.312839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:37.330918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1023/2061] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:37.385687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805b09cc83c34399992003295c5a6e9e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:37.386638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805b09cc83c34399992003295c5a6e9e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:37.387979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805b09cc83c34399992003295c5a6e9e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:37.403080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805b09cc83c34399992003295c5a6e9e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:37.433284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805b09cc83c34399992003295c5a6e9e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:37.471848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1039/2062] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:37 2022] DELETE /identity/v3/users/805b09cc83c34399992003295c5a6e9e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:37.856998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:37.860335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:37.876799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:37.878539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:37.897961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4cd3d-9da2-4a73-ac3e-f7563d319726 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.007180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.007909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.008371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.008791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] PATH_INFO: `/v3/projects/d8aaab5771104eacbca5980002b6a4f6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.010625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8aaab5771104eacbca5980002b6a4f6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.011913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0b10-9c22-4eae-8b5e-f4549fa9e7a1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.014737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.022320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.024127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.024580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.025486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] PATH_INFO: `/v3/projects/0f914b0af855494982bfcceb898b3c6c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.027391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f914b0af855494982bfcceb898b3c6c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.032267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.053963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:38.098086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8aaab5771104eacbca5980002b6a4f6', 'request_id': 'req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.111845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8aaab5771104eacbca5980002b6a4f6', 'request_id': 'req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.122673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8aaab5771104eacbca5980002b6a4f6', 'request_id': 'req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.130531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f914b0af855494982bfcceb898b3c6c', 'request_id': 'req-51f62181-0f13-40ec-a514-fe8eb8708fb6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.141745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f914b0af855494982bfcceb898b3c6c', 'request_id': 'req-51f62181-0f13-40ec-a514-fe8eb8708fb6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.143559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] The token cache is being invalidate because project d8aaab5771104eacbca5980002b6a4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:38.143559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.144382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.146165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1024/2063] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:37 2022] DELETE /identity/v3/projects/d8aaab5771104eacbca5980002b6a4f6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:38.147104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.148852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:38.159127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f914b0af855494982bfcceb898b3c6c', 'request_id': 'req-51f62181-0f13-40ec-a514-fe8eb8708fb6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.166534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:38.177661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] The token cache is being invalidate because project 0f914b0af855494982bfcceb898b3c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:38.178293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.179153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.181560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1040/2064] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:37 2022] DELETE /identity/v3/projects/0f914b0af855494982bfcceb898b3c6c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:38.183271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.187746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:38.251152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ddd7d-415b-4a0e-bd51-c7adae08be76 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.296837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f62181-0f13-40ec-a514-fe8eb8708fb6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.302470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.303106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.303382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.303654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] PATH_INFO: `/v3/users/7457da3ac41e4effb89d48f90f098464` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.304962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7457da3ac41e4effb89d48f90f098464)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.306895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.330145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.330846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.331130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.331399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] PATH_INFO: `/v3/projects/72ed6e1a91994393b364284bec6a1907` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.332628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ed6e1a91994393b364284bec6a1907)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.334820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.360084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7457da3ac41e4effb89d48f90f098464'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.360729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7457da3ac41e4effb89d48f90f098464'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.361376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7457da3ac41e4effb89d48f90f098464'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.368604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7457da3ac41e4effb89d48f90f098464'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.383376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-55b41bf6-cddb-4680-a5ea-76c4d0e32fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7457da3ac41e4effb89d48f90f098464'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.396914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ed6e1a91994393b364284bec6a1907', 'request_id': 'req-40f3e62b-5b90-4c7e-afdb-c502c211abe1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.399725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1041/2065] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:38 2022] DELETE /identity/v3/users/7457da3ac41e4effb89d48f90f098464 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:38.402671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c00fd-6ec6-4b40-92ba-2f386ff55291 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.403531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c00fd-6ec6-4b40-92ba-2f386ff55291 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.403946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841c00fd-6ec6-4b40-92ba-2f386ff55291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.409539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ed6e1a91994393b364284bec6a1907', 'request_id': 'req-40f3e62b-5b90-4c7e-afdb-c502c211abe1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.414031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:38.424169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ed6e1a91994393b364284bec6a1907', 'request_id': 'req-40f3e62b-5b90-4c7e-afdb-c502c211abe1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.437119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-841c00fd-6ec6-4b40-92ba-2f386ff55291 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:38.439253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-841c00fd-6ec6-4b40-92ba-2f386ff55291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:38.442918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] The token cache is being invalidate because project 72ed6e1a91994393b364284bec6a1907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:38.443291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.444229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-40f3e62b-5b90-4c7e-afdb-c502c211abe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:38.446528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1025/2066] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:38 2022] DELETE /identity/v3/projects/72ed6e1a91994393b364284bec6a1907 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:38.453159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685909-a4af-4aec-ac15-fdcacb6b1d5c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.453521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685909-a4af-4aec-ac15-fdcacb6b1d5c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.453800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0685909-a4af-4aec-ac15-fdcacb6b1d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.480215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c0685909-a4af-4aec-ac15-fdcacb6b1d5c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:38.482838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c0685909-a4af-4aec-ac15-fdcacb6b1d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:38.575087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1042/2067] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:38.584118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8243da-3127-4708-a681-339b66f1bb42 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.584569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8243da-3127-4708-a681-339b66f1bb42 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.584921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8243da-3127-4708-a681-339b66f1bb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.592293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1026/2068] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:38.602611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce947d5-d126-42ca-ad5d-ccfbee4cf51f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.603891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce947d5-d126-42ca-ad5d-ccfbee4cf51f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.604700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce947d5-d126-42ca-ad5d-ccfbee4cf51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.606870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-da8243da-3127-4708-a681-339b66f1bb42 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:38.608891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-da8243da-3127-4708-a681-339b66f1bb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:38.626189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1043/2069] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:38.631033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8243da-3127-4708-a681-339b66f1bb42 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.642547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8243da-3127-4708-a681-339b66f1bb42 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.650001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.650411 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.650789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.651190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.651849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:38.652188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.654876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.659032 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:38.660769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3ce947d5-d126-42ca-ad5d-ccfbee4cf51f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:38.662162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3ce947d5-d126-42ca-ad5d-ccfbee4cf51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:38.671312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1044/2070] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:02:38.676148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.683776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1027/2071] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:38.684909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce947d5-d126-42ca-ad5d-ccfbee4cf51f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.698568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce947d5-d126-42ca-ad5d-ccfbee4cf51f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.702897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de548706-c2a3-4611-99cb-1054ccdcffe2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.709261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.710058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.710166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.710572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.710854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.711049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.711490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.711605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:38.711906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.712042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.713515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.713925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.717884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.731569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1028/2072] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:38.733287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.744938 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b19588-0b09-437b-b318-f7647aeffe91 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.752997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.754689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.755352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.755765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.757280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.760346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1045/2073] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/projects => generated 391 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:38.760727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.765458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.824225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1029/2074] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:38.830020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.860917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109aa4c-a8a5-4c4c-b69b-25bd16f77108 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.945578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1d596-1a7a-4322-bd8f-2b4f66885dd9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:38.949036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.949657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.949941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.950216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.950492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:38.950860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.951773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:38.952098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:38.952407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:38.953449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.953643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:38.957456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:38.987296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1030/2075] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:38.988610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:38.992061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1046/2076] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:38 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:38.992369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:38.993157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.004199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05cdf45-a4e2-4297-9d4e-de8335e43e54 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.009265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.010113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.010279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36b558-5b67-4da0-b1a1-112f2bbae3f6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.010424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.010747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.011859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.013895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.020740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.021626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.022024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.022412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] PATH_INFO: `/v3/projects/ef0a1ea8e9c640d2807171cbc052917e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.024907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0a1ea8e9c640d2807171cbc052917e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.027680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1047/2077] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:39.027680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.028903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.039715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af232b-24b3-4e00-8778-f49163e68bdf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.045736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.046467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.046800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.047169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.047767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.049495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.061328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1048/2078] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:39.061971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.072350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843cd31-82c6-4201-b7da-d636e2b07e25 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.078991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.079720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.080106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.080382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.081078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.081622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:39.082750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.093920 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1049/2079] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:39.094761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.108642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0a1ea8e9c640d2807171cbc052917e', 'request_id': 'req-8080d775-c27a-4839-abd3-f418b9fff941'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:39.110185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0027c9-356d-41a0-8db0-b4c80309d8a5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.118433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0a1ea8e9c640d2807171cbc052917e', 'request_id': 'req-8080d775-c27a-4839-abd3-f418b9fff941'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:39.130189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0a1ea8e9c640d2807171cbc052917e', 'request_id': 'req-8080d775-c27a-4839-abd3-f418b9fff941'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:39.148064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] The token cache is being invalidate because project ef0a1ea8e9c640d2807171cbc052917e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:39.148302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:39.148995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:39.150580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1031/2080] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:38 2022] DELETE /identity/v3/projects/ef0a1ea8e9c640d2807171cbc052917e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:39.151320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.152672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:39.158821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:39.190490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620da26-4e72-4d2a-81ab-cf19a0e8a0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.191191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620da26-4e72-4d2a-81ab-cf19a0e8a0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.191471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620da26-4e72-4d2a-81ab-cf19a0e8a0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.191737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620da26-4e72-4d2a-81ab-cf19a0e8a0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.192408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620da26-4e72-4d2a-81ab-cf19a0e8a0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.194036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5620da26-4e72-4d2a-81ab-cf19a0e8a0d8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.212693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1050/2081] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:39.214739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.215200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.215637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.233180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080d775-c27a-4839-abd3-f418b9fff941 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.240736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d8ff1-1836-4642-8ece-f14406e29335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.242222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d8ff1-1836-4642-8ece-f14406e29335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.243312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d8ff1-1836-4642-8ece-f14406e29335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.244042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d8ff1-1836-4642-8ece-f14406e29335 admin admin] PATH_INFO: `/v3/projects/68eaf7c297ec44d490d1f51d71607085/users/ee0f4da17a094e47b9f63d755165feca/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.244292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:39.245517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:39.262286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1051/2082] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:39.263208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.266477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:39.271533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d8ff1-1836-4642-8ece-f14406e29335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68eaf7c297ec44d490d1f51d71607085, user_id=ee0f4da17a094e47b9f63d755165feca, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.277022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d8ff1-1836-4642-8ece-f14406e29335 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.283006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993c415-f3bd-40c9-8df8-13a8015c0957 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.288299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd54437-55ed-4019-8272-a0b7c80d943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.289147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54437-55ed-4019-8272-a0b7c80d943f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.289337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54437-55ed-4019-8272-a0b7c80d943f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.289491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd54437-55ed-4019-8272-a0b7c80d943f admin admin] PATH_INFO: `/v3/projects/847d8691292c496da7a29a8ca6850cb5/users/11bec778cbcb4e59a4d57027c9a9f935/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.298395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1032/2083] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:39 2022] PUT /identity/v3/projects/68eaf7c297ec44d490d1f51d71607085/users/ee0f4da17a094e47b9f63d755165feca/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:39.299531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8dcd6-67fb-4ad5-aafa-2be6928f012d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.300403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8dcd6-67fb-4ad5-aafa-2be6928f012d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.300869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8dcd6-67fb-4ad5-aafa-2be6928f012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.316774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd54437-55ed-4019-8272-a0b7c80d943f admin admin] RBAC: Authorizing `identity:create_grant(project_id=847d8691292c496da7a29a8ca6850cb5, user_id=11bec778cbcb4e59a4d57027c9a9f935, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.320424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd54437-55ed-4019-8272-a0b7c80d943f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.329432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3dc8dcd6-67fb-4ad5-aafa-2be6928f012d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:39.331441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3dc8dcd6-67fb-4ad5-aafa-2be6928f012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:39.341880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1052/2084] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:39 2022] PUT /identity/v3/projects/847d8691292c496da7a29a8ca6850cb5/users/11bec778cbcb4e59a4d57027c9a9f935/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:39.343733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.344058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.344358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.380076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] MFA Rules not processed for user `ee0f4da17a094e47b9f63d755165feca`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:39.381317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:39.426529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1033/2085] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:39.428751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b21c2-d171-4665-91af-a273644eb04c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.429081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b21c2-d171-4665-91af-a273644eb04c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.429389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b21c2-d171-4665-91af-a273644eb04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.453725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9b2b21c2-d171-4665-91af-a273644eb04c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:39.454944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9b2b21c2-d171-4665-91af-a273644eb04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:39.465022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1034/2086] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:39.466050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b21c2-d171-4665-91af-a273644eb04c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.478949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b21c2-d171-4665-91af-a273644eb04c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.484533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.485145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.485543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.485869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.486520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:39.486818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.488793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.495010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1053/2087] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:39.496138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.498050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:39.511241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1035/2088] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:02:39.514377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.532945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b1de2-86e0-4bf4-8a39-e1422a779c0c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.541952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.543095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.543663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.544286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.545244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.547681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.580918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:39.588138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bee45-e0ab-4bf8-a072-fc47c69f2307 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.596267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1036/2089] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:39.598318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.678533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:39.690117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.691065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.692362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.692796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.697730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128ebbf-11f1-4396-83c8-85a8bebe555f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.705177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.706176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.706676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.707160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.708471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.711674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.712436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.715059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.740277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1054/2090] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:39.742985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.760915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1037/2091] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:39.761123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5baf-e6e1-4500-a1a0-cfabf79a9cd3 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.762471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.839410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.840314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.840665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.841006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.842409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.845781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.883591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1055/2092] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:39.888844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989aa6a-4d2b-4aa0-8289-42a1a02e533d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.889948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.909311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.910321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.911022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.911478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.913238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.916741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.921950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02138473-4578-4a94-bb4b-11922ab3d2aa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.929399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.933383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.933383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.933383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:39.933383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:39.934285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:39.958462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1056/2093] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:39.962156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1038/2094] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:39 2022] POST /identity/v3/users => generated 282 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:39.963391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.966983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:39.981391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109b05f-385e-436b-8597-1ad720431236 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.991532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a6c58-1a26-49b9-9c1b-0b4bf639da9a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:39.993959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:39.994739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:39.994914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:39.995306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] PATH_INFO: `/v3/projects/7163c344103c4dd5a8f57b275e9be84c/users/3ef05a5fbeb84b6daad2b3b772e22458/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.010114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:40.011302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.011584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.011870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.012654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.014216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.027035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7163c344103c4dd5a8f57b275e9be84c, user_id=3ef05a5fbeb84b6daad2b3b772e22458, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.030830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.037139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1039/2095] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:40.040526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:40.057974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1057/2096] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:39 2022] PUT /identity/v3/projects/7163c344103c4dd5a8f57b275e9be84c/users/3ef05a5fbeb84b6daad2b3b772e22458/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:40.063224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:40.069914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed0449-3cb3-4ddb-a754-a7ff10b4b78b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:40.166963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:40.167616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.167900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.168214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.168865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.171246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.173719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:40.183289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1040/2097] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:40.187602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:40.192662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606987e5-f40b-483f-a801-98c4339f2c2f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:40.200457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:40.201815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9c9d-b0a2-4cea-a34b-40e2ae94ffb9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:40.202186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.202607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.203022 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.204039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.206663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.207744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d820707-a998-4a5e-b604-c781e33c8094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:40.208383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820707-a998-4a5e-b604-c781e33c8094 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.208671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820707-a998-4a5e-b604-c781e33c8094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.208950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d820707-a998-4a5e-b604-c781e33c8094 admin admin] PATH_INFO: `/v3/projects/c0e6f659881c4eba86fcec6d56074b65/users/3c20e4fd9f0f4505a9f162dbaf34781f/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.231311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1058/2098] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:40.231515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d820707-a998-4a5e-b604-c781e33c8094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0e6f659881c4eba86fcec6d56074b65, user_id=3c20e4fd9f0f4505a9f162dbaf34781f, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.233921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:40.235302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d820707-a998-4a5e-b604-c781e33c8094 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.251829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a7f59-9c5b-4a7e-96d4-d0786e6c01a2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:40.253444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1041/2099] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:40 2022] PUT /identity/v3/projects/c0e6f659881c4eba86fcec6d56074b65/users/3c20e4fd9f0f4505a9f162dbaf34781f/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:40.267393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.267393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.267393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.302831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] MFA Rules not processed for user `3c20e4fd9f0f4505a9f162dbaf34781f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:40.304911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:40.334065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:40.356398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef188f-befb-4b08-85a1-61a669c34832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:40.357945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef188f-befb-4b08-85a1-61a669c34832 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.358413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef188f-befb-4b08-85a1-61a669c34832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.358786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef188f-befb-4b08-85a1-61a669c34832 admin admin] PATH_INFO: `/v3/projects/7163c344103c4dd5a8f57b275e9be84c/users/3ef05a5fbeb84b6daad2b3b772e22458/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.361173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef188f-befb-4b08-85a1-61a669c34832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7163c344103c4dd5a8f57b275e9be84c, user_id=3ef05a5fbeb84b6daad2b3b772e22458, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.365128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef188f-befb-4b08-85a1-61a669c34832 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.388081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1059/2100] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:40 2022] PUT /identity/v3/projects/7163c344103c4dd5a8f57b275e9be84c/users/3ef05a5fbeb84b6daad2b3b772e22458/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:40.392819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.393104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.393477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.425516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1042/2101] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:40.430195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] MFA Rules not processed for user `3ef05a5fbeb84b6daad2b3b772e22458`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:40.431850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:40.434000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:40.435398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:40.510887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5a01a-166f-4552-9324-58421ca6b034 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:40.523535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1060/2102] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:40.537500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:40.539281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:40.573982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869089d-582a-4ec5-b7f8-5c84a0205f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:40.574805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869089d-582a-4ec5-b7f8-5c84a0205f99 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.575118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869089d-582a-4ec5-b7f8-5c84a0205f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.575472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869089d-582a-4ec5-b7f8-5c84a0205f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.638111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:40.659212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867d166-8a1c-4a4d-8ab4-2b7aee0b2d4b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:40.669217 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:40.671541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:40.672364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:40.674188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:40.693706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869089d-582a-4ec5-b7f8-5c84a0205f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.695653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869089d-582a-4ec5-b7f8-5c84a0205f99 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.710424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1043/2103] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:40.812268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:40.814443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:40.847057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1061/2104] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:02:46.260093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e10b5-d550-4e87-95ac-10715095b015 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:46.260727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e10b5-d550-4e87-95ac-10715095b015 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:46.260727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e10b5-d550-4e87-95ac-10715095b015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:46.303333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0f1e10b5-d550-4e87-95ac-10715095b015 None None] MFA Rules not processed for user `11bec778cbcb4e59a4d57027c9a9f935`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:46.304698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0f1e10b5-d550-4e87-95ac-10715095b015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:46.424075 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1044/2105] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:46.426027 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:46.437453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8635-e7b4-455e-b5a8-2df3423c655f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:46.437752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8635-e7b4-455e-b5a8-2df3423c655f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:46.437995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8635-e7b4-455e-b5a8-2df3423c655f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:46.439068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7765c-ef4c-4f47-8646-c177881f1a9e service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:46.444884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:46.446001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:46.446646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:46.447139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:46.463884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:46.466060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:46.472425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f3ed8635-e7b4-455e-b5a8-2df3423c655f None None] MFA Rules not processed for user `11bec778cbcb4e59a4d57027c9a9f935`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:46.474397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f3ed8635-e7b4-455e-b5a8-2df3423c655f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:46.479887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1062/2106] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:46.492765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1045/2107] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:46.505255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:46.507001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:46.513885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:46.646519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de09013-eddc-446b-9fd5-d8e23f785817 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:46.658826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:46.659217 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:46.659506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:46.659891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:46.674567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:46.676129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:46.701864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1063/2108] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:47.924679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fda40-1ca3-4f2b-81a4-7a35d6f1f3a9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:47.931409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fda40-1ca3-4f2b-81a4-7a35d6f1f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:47.931945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155fda40-1ca3-4f2b-81a4-7a35d6f1f3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:47.997354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-155fda40-1ca3-4f2b-81a4-7a35d6f1f3a9 None None] MFA Rules not processed for user `11bec778cbcb4e59a4d57027c9a9f935`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:47.999618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-155fda40-1ca3-4f2b-81a4-7a35d6f1f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:48.012186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1046/2109] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:52.589468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:52.924663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58564c4-f00c-4dec-905f-73e6ab512d4a service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:52.934410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:52.935564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:52.948335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:52.948335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] PATH_INFO: `/v3/users/ee0f4da17a094e47b9f63d755165feca` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:52.948335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee0f4da17a094e47b9f63d755165feca)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:52.949079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:53.108961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee0f4da17a094e47b9f63d755165feca'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:53.112573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee0f4da17a094e47b9f63d755165feca'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:53.113121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee0f4da17a094e47b9f63d755165feca'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:53.132990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee0f4da17a094e47b9f63d755165feca'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:53.176936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee0f4da17a094e47b9f63d755165feca'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:53.209514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1064/2110] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:52 2022] DELETE /identity/v3/users/ee0f4da17a094e47b9f63d755165feca => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:53.212624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7fb25-dbaa-4066-ac90-8a37f7c2b83f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:53.213456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7fb25-dbaa-4066-ac90-8a37f7c2b83f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:53.214196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7fb25-dbaa-4066-ac90-8a37f7c2b83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:53.271187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a2c7fb25-dbaa-4066-ac90-8a37f7c2b83f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:53.272502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a2c7fb25-dbaa-4066-ac90-8a37f7c2b83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:53.467778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1047/2111] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:53.493736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:53.495989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:53.524450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:53.660427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d81a3-41d7-45dc-91df-5842562c23c0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:53.690187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:53.691054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:53.691452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:53.692813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:53.716424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:53.722236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:53.749612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1065/2112] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:02:54.059004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1a25b-ff2a-4576-8b9c-288aba45f7bd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:54.060448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1a25b-ff2a-4576-8b9c-288aba45f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:54.061121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1a25b-ff2a-4576-8b9c-288aba45f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:54.105484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2da1a25b-ff2a-4576-8b9c-288aba45f7bd None None] MFA Rules not processed for user `10b8ab0221404e5cb8b918617e156e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:54.108385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2da1a25b-ff2a-4576-8b9c-288aba45f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:54.221762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:54.248133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1048/2113] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:55.153355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:55.158919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:55.188397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc156-0c80-4a1a-a28a-c7c9f6b54c3d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:55.203881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:55.206109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:55.207014 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:55.208127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] PATH_INFO: `/v3/projects/68eaf7c297ec44d490d1f51d71607085` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:55.210642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68eaf7c297ec44d490d1f51d71607085)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:55.215640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:55.342094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68eaf7c297ec44d490d1f51d71607085', 'request_id': 'req-e2d03d66-8a94-44c0-8245-cb466e121a31'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.358827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68eaf7c297ec44d490d1f51d71607085', 'request_id': 'req-e2d03d66-8a94-44c0-8245-cb466e121a31'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.373912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68eaf7c297ec44d490d1f51d71607085', 'request_id': 'req-e2d03d66-8a94-44c0-8245-cb466e121a31'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.403639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] The token cache is being invalidate because project 68eaf7c297ec44d490d1f51d71607085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:55.404285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.406748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.411817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1066/2114] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:55 2022] DELETE /identity/v3/projects/68eaf7c297ec44d490d1f51d71607085 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:55.418361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1a25b-ff2a-4576-8b9c-288aba45f7bd None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:55.440088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1a25b-ff2a-4576-8b9c-288aba45f7bd None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:55.529388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:55.530065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:55.530425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:55.530684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] PATH_INFO: `/v3/users/3ef05a5fbeb84b6daad2b3b772e22458` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:55.532120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef05a5fbeb84b6daad2b3b772e22458)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:55.534947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:55.616340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef05a5fbeb84b6daad2b3b772e22458'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.623505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef05a5fbeb84b6daad2b3b772e22458'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.625688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef05a5fbeb84b6daad2b3b772e22458'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.643076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef05a5fbeb84b6daad2b3b772e22458'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.662737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d8a6cc24-f6ff-4dde-88b5-d3dc4f4a4568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef05a5fbeb84b6daad2b3b772e22458'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:55.681399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1049/2115] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:02:55 2022] DELETE /identity/v3/users/3ef05a5fbeb84b6daad2b3b772e22458 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:56.539555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:56.543315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:56.567826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d03d66-8a94-44c0-8245-cb466e121a31 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:56.761137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:56.764040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:56.767641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:56.768536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] PATH_INFO: `/v3/projects/7163c344103c4dd5a8f57b275e9be84c` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:56.773329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7163c344103c4dd5a8f57b275e9be84c)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:56.777684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:56.908098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:56.965627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7163c344103c4dd5a8f57b275e9be84c', 'request_id': 'req-3302e600-c57e-45b5-b441-de685c4fbbec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:56.979628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7163c344103c4dd5a8f57b275e9be84c', 'request_id': 'req-3302e600-c57e-45b5-b441-de685c4fbbec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:56.996578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7163c344103c4dd5a8f57b275e9be84c', 'request_id': 'req-3302e600-c57e-45b5-b441-de685c4fbbec'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:57.024406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] The token cache is being invalidate because project 7163c344103c4dd5a8f57b275e9be84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:02:57.025676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:57.028232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3302e600-c57e-45b5-b441-de685c4fbbec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:02:57.037553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1067/2116] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:02:56 2022] DELETE /identity/v3/projects/7163c344103c4dd5a8f57b275e9be84c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:57.040002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7600a-0667-4e15-b1fb-a90f6466ed92 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:57.040721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7600a-0667-4e15-b1fb-a90f6466ed92 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:57.041248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7600a-0667-4e15-b1fb-a90f6466ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:57.072551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-54e7600a-0667-4e15-b1fb-a90f6466ed92 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:57.074592 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-54e7600a-0667-4e15-b1fb-a90f6466ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:57.257199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1050/2117] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:57.271495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251dc48-7de9-4ec7-a32c-074817681b00 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:57.271978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251dc48-7de9-4ec7-a32c-074817681b00 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:57.272875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251dc48-7de9-4ec7-a32c-074817681b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:57.326284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2251dc48-7de9-4ec7-a32c-074817681b00 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:57.338833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2251dc48-7de9-4ec7-a32c-074817681b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:57.355572 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1068/2118] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:57.361646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7600a-0667-4e15-b1fb-a90f6466ed92 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:57.387334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7600a-0667-4e15-b1fb-a90f6466ed92 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:57.402512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:57.405131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:57.405655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:57.406230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:57.407578 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:02:57.408480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:57.414622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:57.445619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251dc48-7de9-4ec7-a32c-074817681b00 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:57.446680 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1051/2119] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:02:57.478010 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251dc48-7de9-4ec7-a32c-074817681b00 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:57.490236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:57.491176 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:57.491975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:57.492704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:57.493943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:57.504147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:57.623593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1069/2120] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:57 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:57.629694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:57.639145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:57.664078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a296e6-a5c1-412d-97e2-c1b66893f8d7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:57.835239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:57.835239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:57.835239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:57.835239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:57.835813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:57.837979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:57.881792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1052/2121] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:57 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:57.889143 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:57.923549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee7bc-fe63-4122-b49c-e0d460bbae62 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:57.951471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:57.952558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:57.953041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:57.953511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:57.955633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:57.959827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:57.995606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1070/2122] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:57.999784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:58.018621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec05fa9-35a7-4795-be80-782690de5d2c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:58.026785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64c838-33b1-48b6-9829-a70aa8120dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:58.028193 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64c838-33b1-48b6-9829-a70aa8120dba admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.029217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64c838-33b1-48b6-9829-a70aa8120dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.029702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64c838-33b1-48b6-9829-a70aa8120dba admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.030906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64c838-33b1-48b6-9829-a70aa8120dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:58.033950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64c838-33b1-48b6-9829-a70aa8120dba admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:58.052079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1053/2123] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:58.054216 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:58.070210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474e3e5-516e-477d-9b9b-f6b8136bbddd admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:58.075767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:58.076495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.076781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.077057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] PATH_INFO: `/v3/projects/71f479e453ca4f4ebab047140af98050/users/00383098d7e6495d848353f2bb1417de/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.095014 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f479e453ca4f4ebab047140af98050, user_id=00383098d7e6495d848353f2bb1417de, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:58.098106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:58.116529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1071/2124] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:58 2022] PUT /identity/v3/projects/71f479e453ca4f4ebab047140af98050/users/00383098d7e6495d848353f2bb1417de/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:58.127715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1e961-c8c1-4e02-8f7e-529574a882ab None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.128230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1e961-c8c1-4e02-8f7e-529574a882ab None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.128230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1e961-c8c1-4e02-8f7e-529574a882ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.161906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-21e1e961-c8c1-4e02-8f7e-529574a882ab None None] MFA Rules not processed for user `00383098d7e6495d848353f2bb1417de`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:58.163613 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-21e1e961-c8c1-4e02-8f7e-529574a882ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:58.257309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1054/2125] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:02:58.263424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:58.394375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53654acf-e6b6-4564-97ae-9dacc02dbeaa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:58.401903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:58.402596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.403254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.403617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.404414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:58.413325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:58.468491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1072/2126] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:58 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:58.469519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1e961-c8c1-4e02-8f7e-529574a882ab None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:58.493971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1e961-c8c1-4e02-8f7e-529574a882ab None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:58.629286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:58.629968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.630282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.633631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.634585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:58.640230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:58.675769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:58.714391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1055/2127] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:58 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:02:58.718353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:58.755976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761203a-7acf-4841-b524-823ef24b9132 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:58.782352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:58.783469 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.784397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.784890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.786055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:58.790790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:58.824636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1073/2128] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:58.829638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:58.848234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255bb9-67c5-4120-ab9b-89adf5c99529 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:58.857227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3680bd-dcef-4e12-8e8b-4879ccc9b361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:58.860642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3680bd-dcef-4e12-8e8b-4879ccc9b361 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.861229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3680bd-dcef-4e12-8e8b-4879ccc9b361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.861579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3680bd-dcef-4e12-8e8b-4879ccc9b361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.863303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3680bd-dcef-4e12-8e8b-4879ccc9b361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:58.864318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3680bd-dcef-4e12-8e8b-4879ccc9b361 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:58.882532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1056/2129] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:58.883177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:58.894713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9c72-6e00-4096-ab82-1ee62a51c698 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:58.904354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:58.905181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:58.905581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:58.905989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] PATH_INFO: `/v3/projects/032a8566f4ec449fa1fccd2514a1399b/users/a0375637b19743d7b242a141196699ae/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:58.935613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032a8566f4ec449fa1fccd2514a1399b, user_id=a0375637b19743d7b242a141196699ae, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:58.938601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:58.958937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1074/2130] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:58 2022] PUT /identity/v3/projects/032a8566f4ec449fa1fccd2514a1399b/users/a0375637b19743d7b242a141196699ae/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:02:59.033752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60445-479e-4a62-96ff-c377f798d256 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:59.034068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60445-479e-4a62-96ff-c377f798d256 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:59.034441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60445-479e-4a62-96ff-c377f798d256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:59.089051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0ae60445-479e-4a62-96ff-c377f798d256 None None] MFA Rules not processed for user `a0375637b19743d7b242a141196699ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:02:59.090684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0ae60445-479e-4a62-96ff-c377f798d256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:02:59.177638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1057/2131] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:02:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:02:59.182393 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:59.192789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:02:59.263814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de8029-eb23-45bb-901c-45689ee7d868 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:59.268881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:59.269501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:59.269791 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:59.270042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:59.270722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:59.272841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:59.307220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1075/2132] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:02:59 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:59.315772 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60445-479e-4a62-96ff-c377f798d256 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:59.328127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60445-479e-4a62-96ff-c377f798d256 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:59.480185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:59.482022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:59.483549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:59.484281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:59.485729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:59.492200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:59.553200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1058/2133] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:02:59 2022] POST /identity/v3/users => generated 294 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:02:59.558441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:59.585826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8815602-c036-46c3-921c-e2ae4e3c412f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:59.600816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:59.601732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:59.602014 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:59.602287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:59.602965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:59.606043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:59.627548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1076/2134] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:02:59.629086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:59.648272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dbd3d-3fff-421f-a73a-578fe8a98c05 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:59.659044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:59.660528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:59.661016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:59.661430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] PATH_INFO: `/v3/projects/87a8734f3e174c118b4d6c6f3971eee1/users/d451d16123c849a3b34d74da1e632f46/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:59.696112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a8734f3e174c118b4d6c6f3971eee1, user_id=d451d16123c849a3b34d74da1e632f46, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:59.701291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:59.736670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1059/2135] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:59 2022] PUT /identity/v3/projects/87a8734f3e174c118b4d6c6f3971eee1/users/d451d16123c849a3b34d74da1e632f46/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:02:59.745137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:59.765525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52bfbe-c46e-45c5-b14f-1e624924d796 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:59.898204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf90bff-ea35-4168-aa0f-46ee80ccfc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:59.899482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90bff-ea35-4168-aa0f-46ee80ccfc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:59.900482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90bff-ea35-4168-aa0f-46ee80ccfc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:59.900976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90bff-ea35-4168-aa0f-46ee80ccfc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:59.901929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf90bff-ea35-4168-aa0f-46ee80ccfc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:59.905894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf90bff-ea35-4168-aa0f-46ee80ccfc04 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:02:59.933725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1077/2136] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:02:59.938570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:02:59.968060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e995e6b-d7c7-4100-96b6-b8bed7a5ff03 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:02:59.980911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:02:59.983090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:02:59.983879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:02:59.984468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] PATH_INFO: `/v3/projects/87a8734f3e174c118b4d6c6f3971eee1/users/d451d16123c849a3b34d74da1e632f46/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:02:59.989830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a8734f3e174c118b4d6c6f3971eee1, user_id=d451d16123c849a3b34d74da1e632f46, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:02:59.996003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:00.036132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1060/2137] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:02:59 2022] PUT /identity/v3/projects/87a8734f3e174c118b4d6c6f3971eee1/users/d451d16123c849a3b34d74da1e632f46/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:00.064073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:00.064073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:00.064073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:00.104222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] MFA Rules not processed for user `d451d16123c849a3b34d74da1e632f46`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:00.105694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:00.254203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1078/2138] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:00.268918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:00.270777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:00.323176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:00.360278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c0f9c-1799-4946-b8f2-1021021a2a94 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:00.364186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:00.364876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:00.365905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:00.365905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:00.457186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:00.458630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:00.470878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1061/2139] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:02.351563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:02.353652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:02.367428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:02.377959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721883-9cdb-4c65-9706-d93d8b63b4d0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:02.386064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:02.386808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:02.387097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:02.387496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:02.465080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:02.466699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:02.479314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1079/2140] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:03.583646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:03.593737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d3dda-85e9-4f5f-8fb5-aa202fd912e2 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:03.597499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021a85b-cd18-4102-b9ce-c3dcbf60bac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:03.598110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021a85b-cd18-4102-b9ce-c3dcbf60bac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:03.598389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021a85b-cd18-4102-b9ce-c3dcbf60bac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:03.598663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021a85b-cd18-4102-b9ce-c3dcbf60bac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:03.608859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021a85b-cd18-4102-b9ce-c3dcbf60bac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:03.610467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021a85b-cd18-4102-b9ce-c3dcbf60bac8 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:03.621689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1062/2141] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:08.268498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:08.498704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d94012-1800-4afa-b9fd-b362e868ff35 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:08.511050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:08.511951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:08.513444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:08.514217 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] PATH_INFO: `/v3/users/00383098d7e6495d848353f2bb1417de` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:08.516692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=00383098d7e6495d848353f2bb1417de)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:08.521261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:08.632403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00383098d7e6495d848353f2bb1417de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:08.633815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00383098d7e6495d848353f2bb1417de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:08.635323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00383098d7e6495d848353f2bb1417de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:08.654097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00383098d7e6495d848353f2bb1417de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:08.696499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00383098d7e6495d848353f2bb1417de'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:08.728829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1080/2142] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:08 2022] DELETE /identity/v3/users/00383098d7e6495d848353f2bb1417de => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:08.736174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:08.737151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:08.737575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:08.773547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:08.778616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:08.900653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1063/2143] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:08.960459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:08.963153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:09.082039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:09.224887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91c42b-8f51-4a36-b29b-6bc042b527ef admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:09.245584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:09.248095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:09.248095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:09.248095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:09.311447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:09.315722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:09.337456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1081/2144] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:03:09.841150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:09.843459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:09.861640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10804716-42df-486a-9e7b-c3bcf885aa6c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:09.869862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:09.871294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:09.872046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:09.872046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] PATH_INFO: `/v3/projects/71f479e453ca4f4ebab047140af98050` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:09.873438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f479e453ca4f4ebab047140af98050)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:09.876727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:09.969795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f479e453ca4f4ebab047140af98050', 'request_id': 'req-5dcc2c9a-5412-4268-bba4-95d46d31239b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:09.978474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f479e453ca4f4ebab047140af98050', 'request_id': 'req-5dcc2c9a-5412-4268-bba4-95d46d31239b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:09.991711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f479e453ca4f4ebab047140af98050', 'request_id': 'req-5dcc2c9a-5412-4268-bba4-95d46d31239b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:09.998741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:10.011462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] The token cache is being invalidate because project 71f479e453ca4f4ebab047140af98050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:10.012471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:10.014468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5dcc2c9a-5412-4268-bba4-95d46d31239b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:10.021664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1064/2145] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:09 2022] DELETE /identity/v3/projects/71f479e453ca4f4ebab047140af98050 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:10.032399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:10.051899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a260a09-f337-49d7-a6a7-01c7e0b39cc0 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:10.173968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:10.175218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:10.175816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:10.176426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] PATH_INFO: `/v3/users/a0375637b19743d7b242a141196699ae` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:10.182614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0375637b19743d7b242a141196699ae)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:10.187369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:10.302351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0375637b19743d7b242a141196699ae'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:10.303422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0375637b19743d7b242a141196699ae'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:10.304248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0375637b19743d7b242a141196699ae'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:10.318576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0375637b19743d7b242a141196699ae'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:10.345620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0375637b19743d7b242a141196699ae'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:10.367168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1082/2146] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:10 2022] DELETE /identity/v3/users/a0375637b19743d7b242a141196699ae => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:10.565105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905131a5-8c0f-426e-b675-5de6ffea5093 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:10.565558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905131a5-8c0f-426e-b675-5de6ffea5093 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:10.566142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905131a5-8c0f-426e-b675-5de6ffea5093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:10.604607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-905131a5-8c0f-426e-b675-5de6ffea5093 None None] MFA Rules not processed for user `33ba92af52134e7aadd45d4503bb0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:10.605904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-905131a5-8c0f-426e-b675-5de6ffea5093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:10.742085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1065/2147] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:10.963035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:10.966246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:11.097969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:11.135256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef6c1-53d3-483c-a015-76e81964015f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:11.142273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:11.143249 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:11.144061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:11.144061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] PATH_INFO: `/v3/projects/032a8566f4ec449fa1fccd2514a1399b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:11.145068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032a8566f4ec449fa1fccd2514a1399b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:11.147061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:11.230792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032a8566f4ec449fa1fccd2514a1399b', 'request_id': 'req-eb0f111e-57bd-4f60-8529-f73e7e596fd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.239431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032a8566f4ec449fa1fccd2514a1399b', 'request_id': 'req-eb0f111e-57bd-4f60-8529-f73e7e596fd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.251273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032a8566f4ec449fa1fccd2514a1399b', 'request_id': 'req-eb0f111e-57bd-4f60-8529-f73e7e596fd1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.273148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] The token cache is being invalidate because project 032a8566f4ec449fa1fccd2514a1399b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:11.273649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.284185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.284185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1083/2148] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:10 2022] DELETE /identity/v3/projects/032a8566f4ec449fa1fccd2514a1399b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:11.284607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905131a5-8c0f-426e-b675-5de6ffea5093 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:11.301943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905131a5-8c0f-426e-b675-5de6ffea5093 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:11.373348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:11.374422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:11.374874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:11.375352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] PATH_INFO: `/v3/users/d451d16123c849a3b34d74da1e632f46` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:11.376761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d451d16123c849a3b34d74da1e632f46)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:11.379709 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:11.492965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd451d16123c849a3b34d74da1e632f46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.493750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd451d16123c849a3b34d74da1e632f46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.494726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd451d16123c849a3b34d74da1e632f46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.506164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd451d16123c849a3b34d74da1e632f46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.526426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a3c6d802-b79a-439b-a330-0dc7a39ea0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd451d16123c849a3b34d74da1e632f46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:11.564074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1066/2149] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:11 2022] DELETE /identity/v3/users/d451d16123c849a3b34d74da1e632f46 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:12.120188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:12.122933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:12.159571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f111e-57bd-4f60-8529-f73e7e596fd1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:12.257981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:12.259231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:12.259841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:12.260436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] PATH_INFO: `/v3/projects/87a8734f3e174c118b4d6c6f3971eee1` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:12.263889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a8734f3e174c118b4d6c6f3971eee1)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:12.266203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:12.354369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a8734f3e174c118b4d6c6f3971eee1', 'request_id': 'req-330860eb-186c-4130-880d-23e375b09fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:12.362580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a8734f3e174c118b4d6c6f3971eee1', 'request_id': 'req-330860eb-186c-4130-880d-23e375b09fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:12.374619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a8734f3e174c118b4d6c6f3971eee1', 'request_id': 'req-330860eb-186c-4130-880d-23e375b09fde'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:12.389561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] The token cache is being invalidate because project 87a8734f3e174c118b4d6c6f3971eee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:12.389849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:12.390826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-330860eb-186c-4130-880d-23e375b09fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:12.392408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1084/2150] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:12 2022] DELETE /identity/v3/projects/87a8734f3e174c118b4d6c6f3971eee1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:12.398784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b362-da67-4ad8-969b-378ab4f8c540 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:12.399441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b362-da67-4ad8-969b-378ab4f8c540 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:12.399758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b362-da67-4ad8-969b-378ab4f8c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:12.462922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-cc46b362-da67-4ad8-969b-378ab4f8c540 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:12.464685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cc46b362-da67-4ad8-969b-378ab4f8c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:12.489763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:12.580821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1067/2151] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:12.586063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84a25-03d2-4c43-ad53-34fba107760a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:12.586560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84a25-03d2-4c43-ad53-34fba107760a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:12.587418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84a25-03d2-4c43-ad53-34fba107760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:12.610098 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:12.662520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-26b84a25-03d2-4c43-ad53-34fba107760a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:12.670869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26b84a25-03d2-4c43-ad53-34fba107760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:12.711483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1085/2152] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:12.720706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b362-da67-4ad8-969b-378ab4f8c540 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:12.747841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b362-da67-4ad8-969b-378ab4f8c540 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:12.763979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:12.765394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:12.766116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:12.768296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:12.769545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:03:12.770063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:12.771837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:12.798599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1068/2153] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:03:12.804945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b84a25-03d2-4c43-ad53-34fba107760a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:12.821840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b84a25-03d2-4c43-ad53-34fba107760a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:12.830394 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:12.831428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:12.832099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:12.832448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:12.833552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:12.842607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:12.899602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1086/2154] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:03:12 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:03:12.905130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:12.924967 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ae462-b7d6-44a8-9e30-5d7f24701966 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.044499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.045233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.045516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.045788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.046448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.048447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.078677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1069/2155] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:03:12 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:03:13.086273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.098701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc76e3-db44-47e5-a8ba-a114905d59cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.104708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.105592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.105999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.106389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.107452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.110044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.130861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1087/2156] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:13.136390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.167055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049bc9e-2ba6-4517-bd01-01970dea0fd8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.175980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a877ba-75ba-4249-8a46-45d40fe646d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.177083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a877ba-75ba-4249-8a46-45d40fe646d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.177594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a877ba-75ba-4249-8a46-45d40fe646d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.178111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a877ba-75ba-4249-8a46-45d40fe646d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.180310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a877ba-75ba-4249-8a46-45d40fe646d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.183609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a877ba-75ba-4249-8a46-45d40fe646d6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.207665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1070/2157] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:13.212901 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.234195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f04b9f-1e4d-451a-bd0d-43f163807652 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.244798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.245841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.246065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.246345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] PATH_INFO: `/v3/projects/0e73b7fe17114d93aaa7afa8f56ec9d6/users/9e728ad19fd9439dbd67f17688fec580/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.276709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e73b7fe17114d93aaa7afa8f56ec9d6, user_id=9e728ad19fd9439dbd67f17688fec580, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.280355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.295615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1088/2158] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:13 2022] PUT /identity/v3/projects/0e73b7fe17114d93aaa7afa8f56ec9d6/users/9e728ad19fd9439dbd67f17688fec580/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:13.308403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80285fb-ca0d-4d5b-9eb2-8e654298c1fb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.308914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80285fb-ca0d-4d5b-9eb2-8e654298c1fb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.309439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80285fb-ca0d-4d5b-9eb2-8e654298c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.354558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e80285fb-ca0d-4d5b-9eb2-8e654298c1fb None None] MFA Rules not processed for user `9e728ad19fd9439dbd67f17688fec580`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:13.355842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e80285fb-ca0d-4d5b-9eb2-8e654298c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:13.437588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1071/2159] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:13.442404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.543559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb4cf3-ddfa-4679-a328-63d37bbe2129 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.549756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.550299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.550575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.550845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.551492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.553630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.585317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1089/2160] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:03:13 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:03:13.589677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80285fb-ca0d-4d5b-9eb2-8e654298c1fb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.601678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80285fb-ca0d-4d5b-9eb2-8e654298c1fb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.618067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:13.673371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.674009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.674275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.674549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.675195 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.677192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.700666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1072/2161] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:03:13 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:13.705195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.716757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d00cf-df67-4133-84fb-ef9ff1e8b7ce admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.722823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.723628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.723911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.724625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.724978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.726622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.739363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1090/2162] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:13.745040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.758114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6279ec0-1328-4eb8-ace2-aa47b265b0c5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.766219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a00ee-89f1-46bd-a9c7-2d8c371614a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.766968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a00ee-89f1-46bd-a9c7-2d8c371614a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.767170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a00ee-89f1-46bd-a9c7-2d8c371614a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.767797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a00ee-89f1-46bd-a9c7-2d8c371614a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.768205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a00ee-89f1-46bd-a9c7-2d8c371614a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.770009 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a00ee-89f1-46bd-a9c7-2d8c371614a8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.785657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1073/2163] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:13.791383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:13.806672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656abd0b-5a25-4e31-95c0-1bc2179013f0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:13.816496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:13.817725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.818132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.818581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] PATH_INFO: `/v3/projects/14bcbc37c2ef468eaca5fa2fb4dbb11c/users/c2a3a74f482b4274b77d7dbab3fd1e90/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.843198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bcbc37c2ef468eaca5fa2fb4dbb11c, user_id=c2a3a74f482b4274b77d7dbab3fd1e90, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:13.846886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:13.873003 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1091/2164] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:13 2022] PUT /identity/v3/projects/14bcbc37c2ef468eaca5fa2fb4dbb11c/users/c2a3a74f482b4274b77d7dbab3fd1e90/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:13.892403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4a21-247d-40b8-b852-41a66be4c18c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:13.892919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4a21-247d-40b8-b852-41a66be4c18c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:13.893421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c4a21-247d-40b8-b852-41a66be4c18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:13.953353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-436c4a21-247d-40b8-b852-41a66be4c18c None None] MFA Rules not processed for user `c2a3a74f482b4274b77d7dbab3fd1e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:13.954610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-436c4a21-247d-40b8-b852-41a66be4c18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:14.069514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1074/2165] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:14.076319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:14.167973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:14.191819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b24614-ac8f-4b1a-9f41-5e536d1d20f6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:14.201744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:14.202374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.202656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.202930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.203592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:14.205552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:14.238628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1092/2166] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:03:14 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:03:14.243012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4a21-247d-40b8-b852-41a66be4c18c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:14.259150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c4a21-247d-40b8-b852-41a66be4c18c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:14.345605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:14.346474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.347031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.347577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.348682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:14.351165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:14.382931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1075/2167] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:03:14 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:14.388824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:14.403573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da695ad7-0dd7-40f6-bf03-19d04861c341 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:14.409897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:14.410856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.411303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.411677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.412477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:14.414409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:14.426203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1093/2168] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:14.431248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:14.442511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8a806-2c78-4427-86a8-32154432864a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:14.447910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:14.448620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.448904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.449183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] PATH_INFO: `/v3/projects/a6cf327536c644bfbf21e50485f70559/users/1599d35cfcb349b697b454ef2ea6ffa8/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.463562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:14.470448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf327536c644bfbf21e50485f70559, user_id=1599d35cfcb349b697b454ef2ea6ffa8, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:14.473995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:14.491723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1076/2169] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:14 2022] PUT /identity/v3/projects/a6cf327536c644bfbf21e50485f70559/users/1599d35cfcb349b697b454ef2ea6ffa8/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:14.495732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:14.506723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e5b1b-120f-4820-bb5d-4e8f0235af22 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:14.584520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494e88a-4f7d-465d-a13b-47cc250534c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:14.585320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494e88a-4f7d-465d-a13b-47cc250534c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.585603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494e88a-4f7d-465d-a13b-47cc250534c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.585908 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494e88a-4f7d-465d-a13b-47cc250534c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.586564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494e88a-4f7d-465d-a13b-47cc250534c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:14.588455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494e88a-4f7d-465d-a13b-47cc250534c1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:14.615108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1094/2170] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:14 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:14.627365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:14.647324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837600-758f-4e06-b6cc-230925e5611c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:14.654982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:14.655716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.656098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.657077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] PATH_INFO: `/v3/projects/a6cf327536c644bfbf21e50485f70559/users/1599d35cfcb349b697b454ef2ea6ffa8/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.659682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6cf327536c644bfbf21e50485f70559, user_id=1599d35cfcb349b697b454ef2ea6ffa8, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:14.662971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:14.684542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1077/2171] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:14 2022] PUT /identity/v3/projects/a6cf327536c644bfbf21e50485f70559/users/1599d35cfcb349b697b454ef2ea6ffa8/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:03:14.694652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55411-da02-41d5-b13d-556786901b00 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.694960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55411-da02-41d5-b13d-556786901b00 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.695240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb55411-da02-41d5-b13d-556786901b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.728375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-efb55411-da02-41d5-b13d-556786901b00 None None] MFA Rules not processed for user `1599d35cfcb349b697b454ef2ea6ffa8`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:14.729575 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-efb55411-da02-41d5-b13d-556786901b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:14.816484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1095/2172] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:14.828716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:14.830876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:14.920305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d6568-274a-480a-95c0-e272e1635635 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:14.926350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:14.927508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:14.927793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:14.928160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:14.993121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:14.993801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:15.008416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1078/2173] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:16.995171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb55411-da02-41d5-b13d-556786901b00 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:17.021163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb55411-da02-41d5-b13d-556786901b00 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:17.043851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:17.045595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:17.046316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:17.048454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:17.167120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:17.183803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:17.186147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:17.198845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1096/2174] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:18.123208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:18.145422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cd7ed-b5a2-42cd-9048-964ec2f51281 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:18.151346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbd6aa-9e7d-456a-aa86-ac4d2d20106e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:18.153024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd6aa-9e7d-456a-aa86-ac4d2d20106e service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:18.153807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd6aa-9e7d-456a-aa86-ac4d2d20106e service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:18.154440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbd6aa-9e7d-456a-aa86-ac4d2d20106e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:18.179119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbd6aa-9e7d-456a-aa86-ac4d2d20106e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:18.181390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbd6aa-9e7d-456a-aa86-ac4d2d20106e service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:18.211805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1079/2175] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:20.110949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:20.112578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:20.194954 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfffc1f-bff0-42a7-92be-50e2c8628799 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:20.200653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:20.201396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:20.201674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:20.201955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] PATH_INFO: `/v3/users/3c20e4fd9f0f4505a9f162dbaf34781f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:20.203096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c20e4fd9f0f4505a9f162dbaf34781f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:20.205105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:20.264517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c20e4fd9f0f4505a9f162dbaf34781f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:20.265092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c20e4fd9f0f4505a9f162dbaf34781f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:20.265718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c20e4fd9f0f4505a9f162dbaf34781f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:20.273112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c20e4fd9f0f4505a9f162dbaf34781f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:20.287832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c20e4fd9f0f4505a9f162dbaf34781f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:20.303574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1097/2176] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:20 2022] DELETE /identity/v3/users/3c20e4fd9f0f4505a9f162dbaf34781f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:20.308204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50f56-f6ff-4901-9fa0-ec468635fcd5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:20.308691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50f56-f6ff-4901-9fa0-ec468635fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:20.308801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe50f56-f6ff-4901-9fa0-ec468635fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:20.329435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9fe50f56-f6ff-4901-9fa0-ec468635fcd5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:20.330720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9fe50f56-f6ff-4901-9fa0-ec468635fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:20.390695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1080/2177] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:20.400821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:20.402386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:20.466677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef93aa-d033-4e70-8eed-253e64f44087 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:20.470440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:20.470991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:20.471268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:20.471603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:20.482261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:20.483693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:20.494026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1098/2178] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:20.858709 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:20.859442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:20.859911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:20.895095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:20.897001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:20.913205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:20.996809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1081/2179] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:03:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:21.015884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:21.017684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:21.040139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576e44a-1de6-4515-80ac-f1d5e76de29c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:21.062058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:21.071879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:21.072413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:21.073055 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] PATH_INFO: `/v3/projects/c0e6f659881c4eba86fcec6d56074b65` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:21.079710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0e6f659881c4eba86fcec6d56074b65)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:21.086981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:21.094273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:21.126598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:21.132466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:21.239802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0e6f659881c4eba86fcec6d56074b65', 'request_id': 'req-e64408d2-fbbc-4310-a85a-2a646fba6c42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:21.251330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0e6f659881c4eba86fcec6d56074b65', 'request_id': 'req-e64408d2-fbbc-4310-a85a-2a646fba6c42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:21.262980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0e6f659881c4eba86fcec6d56074b65', 'request_id': 'req-e64408d2-fbbc-4310-a85a-2a646fba6c42'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:21.274652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90fe4e-4b37-4045-8957-4f0819561c0a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:21.286915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] The token cache is being invalidate because project c0e6f659881c4eba86fcec6d56074b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:21.287397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:21.288400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e64408d2-fbbc-4310-a85a-2a646fba6c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:21.294179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1099/2180] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:21 2022] DELETE /identity/v3/projects/c0e6f659881c4eba86fcec6d56074b65 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:21.300071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b101-f530-4756-adf7-bd87851c1244 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:21.300432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b101-f530-4756-adf7-bd87851c1244 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:21.300714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1b101-f530-4756-adf7-bd87851c1244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:21.327448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8ed1b101-f530-4756-adf7-bd87851c1244 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:21.328718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8ed1b101-f530-4756-adf7-bd87851c1244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:21.422737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:21.424745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:21.425548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:21.426631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:21.430228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:21.448457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1100/2181] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:21.461810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3998-a837-4d52-a5f7-521f443a0bcd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:21.462891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3998-a837-4d52-a5f7-521f443a0bcd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:21.468562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb3998-a837-4d52-a5f7-521f443a0bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:21.494990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eecb3998-a837-4d52-a5f7-521f443a0bcd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:21.497348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eecb3998-a837-4d52-a5f7-521f443a0bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:21.507495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1101/2182] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:21.514660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3998-a837-4d52-a5f7-521f443a0bcd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:21.532783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb3998-a837-4d52-a5f7-521f443a0bcd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:21.542703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:21.546142 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:21.546783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:21.547953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:21.549724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:03:21.550746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:21.554175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:21.566292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:21.568390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:21.581674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1102/2183] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:03:21.587698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:21.597077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1082/2184] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:03:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:03:21.607769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699666a-cf60-4727-816f-26b7432525cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:21.639468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:21.648975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:21.649551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:21.650049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:21.651395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:21.669467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:21.784206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1103/2185] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:03:21 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:21.784543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:21.806039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150bc1e-5fd8-4071-acad-434eb963c700 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:21.814405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:21.974722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:21.976800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:21.977524 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:21.978512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:21.980493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:21.985619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:22.036761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1083/2186] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:03:21 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:22.044934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:22.063880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff31e5b-6fe2-4a2a-8402-bb1a8c8ceb8b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:22.072692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:22.073810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:22.074272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:22.075246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:22.076569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:22.091959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:22.110869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1104/2187] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:22.116425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:22.148063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a21c1a-2401-496a-b4d2-d192824ce5d2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:22.154036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74bf95-af79-4f66-963d-1757e20afdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:22.156622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74bf95-af79-4f66-963d-1757e20afdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:22.156622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74bf95-af79-4f66-963d-1757e20afdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:22.156622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74bf95-af79-4f66-963d-1757e20afdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:22.156622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74bf95-af79-4f66-963d-1757e20afdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:22.159209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74bf95-af79-4f66-963d-1757e20afdbb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:22.182944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1084/2188] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:22.183169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:22.194834 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff84174-1ef0-4974-8a41-1db29525db92 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:22.201912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:22.202957 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:22.203559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:22.204159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] PATH_INFO: `/v3/projects/91574937118f487ba3a9d4324624a2e7/users/98732861f47f4d50b2dd56b59fbe6558/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:22.245805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91574937118f487ba3a9d4324624a2e7, user_id=98732861f47f4d50b2dd56b59fbe6558, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:22.259326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:22.309643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1105/2189] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:22 2022] PUT /identity/v3/projects/91574937118f487ba3a9d4324624a2e7/users/98732861f47f4d50b2dd56b59fbe6558/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:03:22.322700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484e041-13da-4341-850b-4b6845711589 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:22.328581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484e041-13da-4341-850b-4b6845711589 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:22.330632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484e041-13da-4341-850b-4b6845711589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:22.386156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1484e041-13da-4341-850b-4b6845711589 None None] MFA Rules not processed for user `98732861f47f4d50b2dd56b59fbe6558`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:22.388402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1484e041-13da-4341-850b-4b6845711589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:22.546405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1085/2190] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:22.556113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:22.559831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:22.612370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:22.779110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cab75c-ba71-4e88-af24-008fbed411e1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:22.783392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:22.784174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:22.784601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:22.784880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:22.800378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:22.801899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:22.818880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1106/2191] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:22.863429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484e041-13da-4341-850b-4b6845711589 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:23.102342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:23.104692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:23.115312 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484e041-13da-4341-850b-4b6845711589 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:23.125440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b39b0-272a-479d-b97b-af06f108aa93 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:23.131240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:23.132038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:23.132347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:23.132907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] PATH_INFO: `/v3/users/9e728ad19fd9439dbd67f17688fec580` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:23.134954 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e728ad19fd9439dbd67f17688fec580)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:23.137724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:23.145081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:23.146209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:23.146710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:23.147856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] PATH_INFO: `/v3/users/98732861f47f4d50b2dd56b59fbe6558` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:23.150097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98732861f47f4d50b2dd56b59fbe6558)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:23.156695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:23.206258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:23.240820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e728ad19fd9439dbd67f17688fec580'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.242531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e728ad19fd9439dbd67f17688fec580'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.244233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e728ad19fd9439dbd67f17688fec580'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.269273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e728ad19fd9439dbd67f17688fec580'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.283788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98732861f47f4d50b2dd56b59fbe6558'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.285338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98732861f47f4d50b2dd56b59fbe6558'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.285543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98732861f47f4d50b2dd56b59fbe6558'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.298083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3fdba8a1-c5f4-4416-8e22-0998f0cefa18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e728ad19fd9439dbd67f17688fec580'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.298816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98732861f47f4d50b2dd56b59fbe6558'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.320359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1107/2192] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:23 2022] DELETE /identity/v3/users/9e728ad19fd9439dbd67f17688fec580 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:23.322109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-592671dc-c65b-463c-8b9e-b69526c88152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98732861f47f4d50b2dd56b59fbe6558'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:23.327883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:23.328961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:23.330051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:23.354104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1086/2193] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:22 2022] DELETE /identity/v3/users/98732861f47f4d50b2dd56b59fbe6558 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:23.360707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:23.361077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:23.361431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:23.374070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:23.375460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:23.396480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:23.398760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:23.557634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1087/2194] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:23.569337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1108/2195] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:23.571608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:23.573724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:23.583314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:23.589078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:23.663765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:23.711250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24284-ef41-4632-8db8-84772e78b5c5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:23.718342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:23.719279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:23.721372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:23.721372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:23.738150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:23.740489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:23.754041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1109/2196] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:23.803552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c257e-9f72-41a0-9424-cf0f870dc042 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:23.808492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415dfc25-c1ef-4458-b669-821ce7ee4cac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:23.810456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dfc25-c1ef-4458-b669-821ce7ee4cac service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:23.810851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dfc25-c1ef-4458-b669-821ce7ee4cac service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:23.811239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415dfc25-c1ef-4458-b669-821ce7ee4cac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:23.824798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dfc25-c1ef-4458-b669-821ce7ee4cac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:23.826653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415dfc25-c1ef-4458-b669-821ce7ee4cac service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:23.841715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1088/2197] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:03:24.639568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:24.655762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:24.702272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:24.703555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:24.703781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:24.716924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288b0f0-2224-4f5a-b83b-63d4ccc86aff service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:24.736574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:24.737955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:24.738462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:24.739030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] PATH_INFO: `/v3/projects/0e73b7fe17114d93aaa7afa8f56ec9d6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:24.748685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e73b7fe17114d93aaa7afa8f56ec9d6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:24.754438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:24.759161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:24.767306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:24.862668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:24.915862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1089/2198] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:24.916921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:24.919431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:24.937589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1ad47-8048-4aca-a1c0-1dace72bb335 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:24.947562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e73b7fe17114d93aaa7afa8f56ec9d6', 'request_id': 'req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:24.982419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e73b7fe17114d93aaa7afa8f56ec9d6', 'request_id': 'req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.005707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e73b7fe17114d93aaa7afa8f56ec9d6', 'request_id': 'req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.052794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] The token cache is being invalidate because project 0e73b7fe17114d93aaa7afa8f56ec9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:25.053385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.054669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.058181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1110/2199] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:24 2022] DELETE /identity/v3/projects/0e73b7fe17114d93aaa7afa8f56ec9d6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:25.059433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:25.061224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:25.119968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:25.121490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:25.122268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:25.124104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] PATH_INFO: `/v3/projects/91574937118f487ba3a9d4324624a2e7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:25.126739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91574937118f487ba3a9d4324624a2e7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:25.131556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:25.266872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d9dd-526c-436a-b5b2-69dfaddd6e5a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:25.310006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91574937118f487ba3a9d4324624a2e7', 'request_id': 'req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.323699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91574937118f487ba3a9d4324624a2e7', 'request_id': 'req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.356062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91574937118f487ba3a9d4324624a2e7', 'request_id': 'req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.467681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] The token cache is being invalidate because project 91574937118f487ba3a9d4324624a2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:25.469040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.473828 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:25.502029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1090/2200] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:24 2022] DELETE /identity/v3/projects/91574937118f487ba3a9d4324624a2e7 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:25.502029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:25.502029 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:25.607632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:25.666864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22d23-aeec-4298-9147-c41a9d307eb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:25.668437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22d23-aeec-4298-9147-c41a9d307eb3 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:25.669069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22d23-aeec-4298-9147-c41a9d307eb3 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:25.669485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22d23-aeec-4298-9147-c41a9d307eb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:25.686219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bba22d23-aeec-4298-9147-c41a9d307eb3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:25.826227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b58fd-8d68-4b9a-9698-a4e10a1bc4a5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:25.856666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:25.858719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:25.859269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:25.859913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] PATH_INFO: `/v3/users/c2a3a74f482b4274b77d7dbab3fd1e90` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:25.864520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a3a74f482b4274b77d7dbab3fd1e90)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:25.872383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba22d23-aeec-4298-9147-c41a9d307eb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:25.872690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:25.874118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba22d23-aeec-4298-9147-c41a9d307eb3 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:25.909943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1111/2201] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:03:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 851 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:03:25.911024 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5efb9-02b1-40e4-ae69-501b1aa71cb0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:25.911305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5efb9-02b1-40e4-ae69-501b1aa71cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:25.911580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5efb9-02b1-40e4-ae69-501b1aa71cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:25.935763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:25.975087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f6f5efb9-02b1-40e4-ae69-501b1aa71cb0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:25.976434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f6f5efb9-02b1-40e4-ae69-501b1aa71cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:26.014044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a3a74f482b4274b77d7dbab3fd1e90'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:26.014320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a3a74f482b4274b77d7dbab3fd1e90'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:26.015355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a3a74f482b4274b77d7dbab3fd1e90'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:26.018129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1112/2202] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:26.028059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a3a74f482b4274b77d7dbab3fd1e90'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:26.033803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940a0d4-62fb-4bf9-9d3c-8b577a978e3d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:26.036101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940a0d4-62fb-4bf9-9d3c-8b577a978e3d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:26.036298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940a0d4-62fb-4bf9-9d3c-8b577a978e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:26.051579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a3a74f482b4274b77d7dbab3fd1e90'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:26.094805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c940a0d4-62fb-4bf9-9d3c-8b577a978e3d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:26.097962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1091/2203] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:25 2022] DELETE /identity/v3/users/c2a3a74f482b4274b77d7dbab3fd1e90 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:26.118382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c940a0d4-62fb-4bf9-9d3c-8b577a978e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:26.321278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1113/2204] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:26.328134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:26.342863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b344-7638-4c64-b1b5-173f5e7e3a9e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:26.376351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:26.377860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:26.383878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:26.384439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:26.385477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:03:26.385960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:26.388402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:26.425488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940a0d4-62fb-4bf9-9d3c-8b577a978e3d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:26.434151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1092/2205] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:03:26.437916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940a0d4-62fb-4bf9-9d3c-8b577a978e3d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:26.456226 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:26.457397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:26.457801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:26.458077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:26.459177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:26.461583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:26.550020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:26.562452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1114/2206] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:03:26 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:26.569538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06c964-2f1e-436c-a4a0-99f7b9c72f36 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:26.847925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:26.849405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:26.850025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:26.850509 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:26.851385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:26.853598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:26.907825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1093/2207] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:03:26 2022] POST /identity/v3/users => generated 286 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:26.909630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:26.940734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665ea4a-fd90-46d3-b8b1-696f9cc271cc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:26.956975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:26.957959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:26.958124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:26.958402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:26.959075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:26.960953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:26.996612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1115/2208] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:26.999921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:27.014318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab1768-b95e-4bc2-b222-1cd0c5707a93 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:27.033813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:27.034441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:27.034723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:27.034991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:27.035647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:27.037328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:27.083532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1094/2209] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:27.088438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:27.109281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:27.111418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:27.125491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148aa2-b23f-4248-8b97-87b9bffd0475 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:27.143796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00c801-a470-4f1f-8520-94267604d7a4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:27.150919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74987739-fd6b-4008-8f28-34340d28eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:27.159931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:27.160628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:27.160907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:27.161186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] PATH_INFO: `/v3/projects/14bcbc37c2ef468eaca5fa2fb4dbb11c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:27.162887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bcbc37c2ef468eaca5fa2fb4dbb11c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:27.163040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987739-fd6b-4008-8f28-34340d28eff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:27.163423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987739-fd6b-4008-8f28-34340d28eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:27.163708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987739-fd6b-4008-8f28-34340d28eff4 admin admin] PATH_INFO: `/v3/projects/842d24943400476b97cabcdf7deeb8d9/users/2b5581c235884aee88848433446da0b2/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:27.168320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:27.235688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74987739-fd6b-4008-8f28-34340d28eff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842d24943400476b97cabcdf7deeb8d9, user_id=2b5581c235884aee88848433446da0b2, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:27.255986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74987739-fd6b-4008-8f28-34340d28eff4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:27.292154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1116/2210] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:27 2022] PUT /identity/v3/projects/842d24943400476b97cabcdf7deeb8d9/users/2b5581c235884aee88848433446da0b2/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:27.308193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:27.312174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:27.313172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:27.354706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bcbc37c2ef468eaca5fa2fb4dbb11c', 'request_id': 'req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.358561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:27.364452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bcbc37c2ef468eaca5fa2fb4dbb11c', 'request_id': 'req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.377155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] MFA Rules not processed for user `2b5581c235884aee88848433446da0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:27.377982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bcbc37c2ef468eaca5fa2fb4dbb11c', 'request_id': 'req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.379130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:27.399716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] The token cache is being invalidate because project 14bcbc37c2ef468eaca5fa2fb4dbb11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:27.400232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.401384 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.403852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1095/2211] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:27 2022] DELETE /identity/v3/projects/14bcbc37c2ef468eaca5fa2fb4dbb11c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:27.415241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:27.438252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:27.452377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:27.665508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1117/2212] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:27.699522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:27.701953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:27.705692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc2e98-fb5d-46ff-b835-8975b69f14f4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:27.722145 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:27.722822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:27.723104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:27.725431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] PATH_INFO: `/v3/users/1599d35cfcb349b697b454ef2ea6ffa8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:27.727290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1599d35cfcb349b697b454ef2ea6ffa8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:27.729504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:27.876194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ae5d6-9764-444f-a8e7-1bf09442d38d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:27.882947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:27.896852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:27.900624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:27.901350 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:27.904436 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1599d35cfcb349b697b454ef2ea6ffa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.906235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1599d35cfcb349b697b454ef2ea6ffa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.909346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1599d35cfcb349b697b454ef2ea6ffa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.916664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:27.920747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:27.947069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1118/2213] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:27.948581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1599d35cfcb349b697b454ef2ea6ffa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:27.996836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1599d35cfcb349b697b454ef2ea6ffa8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:28.046421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1096/2214] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:27 2022] DELETE /identity/v3/users/1599d35cfcb349b697b454ef2ea6ffa8 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:03:29.157850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:29.176041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae823be-798d-44b3-9228-75ddfc6df6d0 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:29.378229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:29.379259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:29.379719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:29.380482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] PATH_INFO: `/v3/projects/a6cf327536c644bfbf21e50485f70559` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:29.382678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6cf327536c644bfbf21e50485f70559)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:29.387048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:29.474035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cf327536c644bfbf21e50485f70559', 'request_id': 'req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:29.482685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cf327536c644bfbf21e50485f70559', 'request_id': 'req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:29.499296 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cf327536c644bfbf21e50485f70559', 'request_id': 'req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:29.515911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:29.522240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] The token cache is being invalidate because project a6cf327536c644bfbf21e50485f70559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:29.522553 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:29.524572 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a3675426-e9fc-43a5-b0fe-abad2b3e66a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:29.530764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1119/2215] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:29 2022] DELETE /identity/v3/projects/a6cf327536c644bfbf21e50485f70559 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:38.034621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=58,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:39.545817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:43.233203 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:43.234713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:43.250920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2184f6-994f-4c38-bc81-f2a19a5b79d9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:43.325723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:43.326363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:43.326645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:43.326918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] PATH_INFO: `/v3/users/2b5581c235884aee88848433446da0b2` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:43.328076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5581c235884aee88848433446da0b2)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:43.329990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:43.400076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5581c235884aee88848433446da0b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:43.400845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5581c235884aee88848433446da0b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:43.401646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5581c235884aee88848433446da0b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:43.411500 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5581c235884aee88848433446da0b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:43.431539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5581c235884aee88848433446da0b2'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:43.453122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1097/2216] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:43 2022] DELETE /identity/v3/users/2b5581c235884aee88848433446da0b2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:43.458661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:43.459762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:43.459762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:43.491796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:43.494092 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:43.607793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1120/2217] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:43.624494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:43.626211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:43.729678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af4921-a316-4348-b94e-82e7c36e2c3d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:43.738641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc4bff-705b-410e-9190-73cc07c87873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:43.740181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4bff-705b-410e-9190-73cc07c87873 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:43.740830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4bff-705b-410e-9190-73cc07c87873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:43.741595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc4bff-705b-410e-9190-73cc07c87873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:43.760640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc4bff-705b-410e-9190-73cc07c87873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:43.763444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc4bff-705b-410e-9190-73cc07c87873 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:43.777764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1098/2218] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:44.413071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:44.415060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:44.432835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ebe5c-4563-4089-b357-cacf9869ce92 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:44.443451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:44.444739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:44.445508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:44.445675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] PATH_INFO: `/v3/projects/842d24943400476b97cabcdf7deeb8d9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:44.447120 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842d24943400476b97cabcdf7deeb8d9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:44.449951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:44.511704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842d24943400476b97cabcdf7deeb8d9', 'request_id': 'req-fc86b63b-a142-44d4-9cca-4a088170f1e0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:44.529093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842d24943400476b97cabcdf7deeb8d9', 'request_id': 'req-fc86b63b-a142-44d4-9cca-4a088170f1e0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:44.540702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842d24943400476b97cabcdf7deeb8d9', 'request_id': 'req-fc86b63b-a142-44d4-9cca-4a088170f1e0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:44.566624 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] The token cache is being invalidate because project 842d24943400476b97cabcdf7deeb8d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:44.566991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:44.567614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fc86b63b-a142-44d4-9cca-4a088170f1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:44.569833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1121/2219] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:44 2022] DELETE /identity/v3/projects/842d24943400476b97cabcdf7deeb8d9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:44.574512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641ac7-68af-4095-94f1-e56cf1bd0f8a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:44.575048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641ac7-68af-4095-94f1-e56cf1bd0f8a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:44.575048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d641ac7-68af-4095-94f1-e56cf1bd0f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:44.596321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3d641ac7-68af-4095-94f1-e56cf1bd0f8a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:44.597532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3d641ac7-68af-4095-94f1-e56cf1bd0f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:44.637859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:44.704915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1099/2220] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:44.713638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d158-b254-46b5-905a-8c63bcff7185 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:44.713925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d158-b254-46b5-905a-8c63bcff7185 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:44.714234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638d158-b254-46b5-905a-8c63bcff7185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:44.736334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d638d158-b254-46b5-905a-8c63bcff7185 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:44.737558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d638d158-b254-46b5-905a-8c63bcff7185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:44.748461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1122/2221] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:44.752692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641ac7-68af-4095-94f1-e56cf1bd0f8a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:44.764151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d641ac7-68af-4095-94f1-e56cf1bd0f8a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:44.771402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:44.772103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:44.772465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:44.772694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:44.773504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:03:44.773973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:44.775785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:44.794395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1100/2222] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:03:44.795528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638d158-b254-46b5-905a-8c63bcff7185 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:44.807533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638d158-b254-46b5-905a-8c63bcff7185 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:44.813823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:44.814483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:44.815016 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:44.815285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:44.816061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:44.818315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:44.858798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1123/2223] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:03:44 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:44.860090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:44.872575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d63d7-1c02-4d4e-a6d5-5a2b0f368ce1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:44.953740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:44.954796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:44.955081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:44.955499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:44.956282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:44.958236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:44.994463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1101/2224] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:03:44 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:03:44.999203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:45.015081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88006471-c4ee-41fc-ac13-c9ec39f5b5e1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:45.042062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:45.043587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:45.046694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:45.046694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:45.048535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:45.053571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:45.067245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1124/2225] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:45.074398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:45.092916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa5f70-72bd-4800-ba8a-fb3a233a3bee admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:45.103438 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9acea-7959-4050-9717-0be944585580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:45.105096 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9acea-7959-4050-9717-0be944585580 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:45.106186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9acea-7959-4050-9717-0be944585580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:45.106850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9acea-7959-4050-9717-0be944585580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:45.108236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9acea-7959-4050-9717-0be944585580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:45.111471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9acea-7959-4050-9717-0be944585580 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:45.131634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1102/2226] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:45.133087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:45.151255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87023da1-81fd-4b17-80ff-454d10050834 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:45.158257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:45.159112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:45.159563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:45.159987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] PATH_INFO: `/v3/projects/101ad244a4624d32972b0d9e62d0422e/users/a0eae33ec289448d81c0ffc5d30d84a1/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:45.192869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101ad244a4624d32972b0d9e62d0422e, user_id=a0eae33ec289448d81c0ffc5d30d84a1, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:45.195534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:45.226140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1125/2227] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:45 2022] PUT /identity/v3/projects/101ad244a4624d32972b0d9e62d0422e/users/a0eae33ec289448d81c0ffc5d30d84a1/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:45.244230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39bcce-2c5a-459f-8e85-d66c2b2d4fed None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:45.245030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39bcce-2c5a-459f-8e85-d66c2b2d4fed None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:45.245617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39bcce-2c5a-459f-8e85-d66c2b2d4fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:45.297103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ae39bcce-2c5a-459f-8e85-d66c2b2d4fed None None] MFA Rules not processed for user `a0eae33ec289448d81c0ffc5d30d84a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:45.298795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ae39bcce-2c5a-459f-8e85-d66c2b2d4fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:45.474671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1103/2228] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:45.486983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:45.489826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:45.519344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:45.571859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea09359-29d7-4f59-9576-1a9a634ff518 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:45.578795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a3620-af4a-430d-8ddd-ab9c708bca30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:45.578795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3620-af4a-430d-8ddd-ab9c708bca30 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:45.578795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3620-af4a-430d-8ddd-ab9c708bca30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:45.579217 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a3620-af4a-430d-8ddd-ab9c708bca30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:45.596266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a3620-af4a-430d-8ddd-ab9c708bca30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:45.598375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a3620-af4a-430d-8ddd-ab9c708bca30 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:45.613622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1126/2229] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:47.251018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:47.251612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:47.251612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:47.286961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] MFA Rules not processed for user `a0eae33ec289448d81c0ffc5d30d84a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:47.288853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:47.324663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1104/2230] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:48.278239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0248e-c55f-403f-ab50-3a1fd598080e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:48.279614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0248e-c55f-403f-ab50-3a1fd598080e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:48.279946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0248e-c55f-403f-ab50-3a1fd598080e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:48.305852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-3cf0248e-c55f-403f-ab50-3a1fd598080e None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:48.307551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3cf0248e-c55f-403f-ab50-3a1fd598080e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:48.376814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1127/2231] 10.222.0.50 () {58 vars in 967 bytes} [Wed Sep 14 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:48.392000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:48.393607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:48.411157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:48.487198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a063e7-cc03-4336-b069-6fa8b25d22ef None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:48.494441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b450bf-ff0c-49ba-a87b-3d5483820e6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:48.495124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b450bf-ff0c-49ba-a87b-3d5483820e6b service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:48.495398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b450bf-ff0c-49ba-a87b-3d5483820e6b service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:48.495669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b450bf-ff0c-49ba-a87b-3d5483820e6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:48.506249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b450bf-ff0c-49ba-a87b-3d5483820e6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:48.507993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b450bf-ff0c-49ba-a87b-3d5483820e6b service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:48.519368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1105/2232] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:03:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:03:48.984524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ffe2-a91c-4e2b-bbbe-7c32a73ee589 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:48.985094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ffe2-a91c-4e2b-bbbe-7c32a73ee589 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:48.985529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c1ffe2-a91c-4e2b-bbbe-7c32a73ee589 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:48.987025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1128/2233] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:03:48.994012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919367c-d7ae-4e91-bad0-c9b8af721454 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:48.994702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919367c-d7ae-4e91-bad0-c9b8af721454 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:48.995221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919367c-d7ae-4e91-bad0-c9b8af721454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.046111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1919367c-d7ae-4e91-bad0-c9b8af721454 None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:49.047639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1919367c-d7ae-4e91-bad0-c9b8af721454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:49.171624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1106/2234] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:49.193965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ffe2-a91c-4e2b-bbbe-7c32a73ee589 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:49.196389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-39c1ffe2-a91c-4e2b-bbbe-7c32a73ee589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:49.299136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c1ffe2-a91c-4e2b-bbbe-7c32a73ee589 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:49.302894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3885da-1688-43ce-8da6-9f7f49e9f5e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:49.303523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3885da-1688-43ce-8da6-9f7f49e9f5e9 service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:49.303873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3885da-1688-43ce-8da6-9f7f49e9f5e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:49.304178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3885da-1688-43ce-8da6-9f7f49e9f5e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.319033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3885da-1688-43ce-8da6-9f7f49e9f5e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:49.320684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3885da-1688-43ce-8da6-9f7f49e9f5e9 service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:49.335383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1129/2235] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:49.418674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180cc2-2a4b-4715-a577-5a5537565db2 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:49.419215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180cc2-2a4b-4715-a577-5a5537565db2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:49.419504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99180cc2-2a4b-4715-a577-5a5537565db2 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.421198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1107/2236] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:03:49.427947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34a46b-827e-44fc-b20f-00bf21a91f76 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:49.428558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34a46b-827e-44fc-b20f-00bf21a91f76 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:49.429097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34a46b-827e-44fc-b20f-00bf21a91f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.461748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eb34a46b-827e-44fc-b20f-00bf21a91f76 None None] MFA Rules not processed for user `f5ca117fa96d412e9bda506591a01fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:49.462980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eb34a46b-827e-44fc-b20f-00bf21a91f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:49.521674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:49.529814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1130/2237] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:03:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:49.542056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99180cc2-2a4b-4715-a577-5a5537565db2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:49.544872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-99180cc2-2a4b-4715-a577-5a5537565db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:49.559486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99180cc2-2a4b-4715-a577-5a5537565db2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:49.563419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2659ef6-6e57-435a-bc46-92616bb743bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:49.564046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659ef6-6e57-435a-bc46-92616bb743bb service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:49.564342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659ef6-6e57-435a-bc46-92616bb743bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:49.564746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659ef6-6e57-435a-bc46-92616bb743bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.572492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2659ef6-6e57-435a-bc46-92616bb743bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:49.574150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2659ef6-6e57-435a-bc46-92616bb743bb service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:49.589182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1108/2238] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:49.694287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ec64d-4c59-405b-8ced-db0ad1761f9e None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:49.694607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ec64d-4c59-405b-8ced-db0ad1761f9e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:49.694886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ec64d-4c59-405b-8ced-db0ad1761f9e None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.696340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1131/2239] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:03:49.704036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393a12-af50-4fc8-afd5-a08d278c010d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:49.704324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393a12-af50-4fc8-afd5-a08d278c010d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:49.704600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393a12-af50-4fc8-afd5-a08d278c010d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.725218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-73393a12-af50-4fc8-afd5-a08d278c010d None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:49.726489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-73393a12-af50-4fc8-afd5-a08d278c010d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:49.736543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1109/2240] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:03:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:49.747158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ec64d-4c59-405b-8ced-db0ad1761f9e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:49.760209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ec64d-4c59-405b-8ced-db0ad1761f9e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:49.764670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8e9c1-bec4-4942-8cc0-b3b1622d15fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:49.766184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8e9c1-bec4-4942-8cc0-b3b1622d15fa service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:49.766582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8e9c1-bec4-4942-8cc0-b3b1622d15fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:49.766929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8e9c1-bec4-4942-8cc0-b3b1622d15fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:49.781241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8e9c1-bec4-4942-8cc0-b3b1622d15fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:49.783232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8e9c1-bec4-4942-8cc0-b3b1622d15fa service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:49.797903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1132/2241] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:51.107382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52ce7-9e92-44ea-8289-baccbe922e2b None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:51.107874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52ce7-9e92-44ea-8289-baccbe922e2b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:51.107979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc52ce7-9e92-44ea-8289-baccbe922e2b None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:51.109318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1110/2242] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:03:51.118726 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:51.119256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:51.119256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:51.165148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] MFA Rules not processed for user `75d6d17c6b22402ca39158a737027f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:51.166977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:51.204939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc52ce7-9e92-44ea-8289-baccbe922e2b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:51.206956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cbc52ce7-9e92-44ea-8289-baccbe922e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:51.287528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1133/2243] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:03:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:51.303222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:51.304958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:51.320433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f731f9-dfac-4560-9790-6530d2c6ab79 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:51.327567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:51.328501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:51.329090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:51.329616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:51.343506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:51.345875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:51.346444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc52ce7-9e92-44ea-8289-baccbe922e2b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:51.363166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1134/2244] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:03:51.365202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:51.366133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:51.366561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:51.366940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] PATH_INFO: `/v3/users/10b8ab0221404e5cb8b918617e156e8b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:51.368683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b8ab0221404e5cb8b918617e156e8b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:51.371175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:51.392501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:51.485226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b8ab0221404e5cb8b918617e156e8b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:51.485908 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b8ab0221404e5cb8b918617e156e8b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:51.486558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b8ab0221404e5cb8b918617e156e8b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:51.494705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b8ab0221404e5cb8b918617e156e8b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:51.509266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ba34c379-0f6c-4d4e-903a-e37a4557d2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b8ab0221404e5cb8b918617e156e8b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:51.526736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1111/2245] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:03:51 2022] DELETE /identity/v3/users/10b8ab0221404e5cb8b918617e156e8b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:51.975447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:51.991573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fe8d-c1cf-4389-a8a3-3cc155033074 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.073385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.074709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.075278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.075766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] PATH_INFO: `/v3/projects/1cb990610b5841d6af0d15167963c239` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.077778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb990610b5841d6af0d15167963c239)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.080382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.142719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb990610b5841d6af0d15167963c239', 'request_id': 'req-8eb95bff-af9d-4ca7-853d-c8541c163026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:52.149714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb990610b5841d6af0d15167963c239', 'request_id': 'req-8eb95bff-af9d-4ca7-853d-c8541c163026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:52.159070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb990610b5841d6af0d15167963c239', 'request_id': 'req-8eb95bff-af9d-4ca7-853d-c8541c163026'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:52.169008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:52.175830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] The token cache is being invalidate because project 1cb990610b5841d6af0d15167963c239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:03:52.176366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:52.177873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-8eb95bff-af9d-4ca7-853d-c8541c163026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:03:52.179532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1135/2246] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:03:51 2022] DELETE /identity/v3/projects/1cb990610b5841d6af0d15167963c239 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:52.184761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6cd6b-4c38-4101-83a7-fd483f2a5a54 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.185445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6cd6b-4c38-4101-83a7-fd483f2a5a54 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.185445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6cd6b-4c38-4101-83a7-fd483f2a5a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.206458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-25f6cd6b-4c38-4101-83a7-fd483f2a5a54 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:52.207769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-25f6cd6b-4c38-4101-83a7-fd483f2a5a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:52.300073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1112/2247] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:52.301410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c078f-f8d9-4e44-8707-f0062cf1943c None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.301410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c078f-f8d9-4e44-8707-f0062cf1943c None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.301410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c078f-f8d9-4e44-8707-f0062cf1943c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.332408 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ec8c078f-f8d9-4e44-8707-f0062cf1943c None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:52.335739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ec8c078f-f8d9-4e44-8707-f0062cf1943c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:52.357856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1136/2248] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:52.358562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6cd6b-4c38-4101-83a7-fd483f2a5a54 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:52.372684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6cd6b-4c38-4101-83a7-fd483f2a5a54 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.377690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.378325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.378611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.378888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.379546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:03:52.379899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.381471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.396606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1113/2249] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:03:52.401468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c078f-f8d9-4e44-8707-f0062cf1943c None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:52.411544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c078f-f8d9-4e44-8707-f0062cf1943c None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.416445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.417045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.417336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.417583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.418277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.420512 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.449202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1137/2250] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:03:52 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:03:52.454265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:52.468270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4680a-1f18-493b-9b9c-96c5490b055c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.546304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.547071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.547588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.548159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.549039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.551076 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.578002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1114/2251] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:03:52 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:03:52.582349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:52.593592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ca536-49fa-494d-8311-4e42b8dea90e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.598593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.599189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.599462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.599732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.600432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.601999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.615930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1138/2252] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:03:52.616973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:52.628329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd65dd-e88c-4273-9a59-bc7829930798 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.633304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463ddf49-16a2-440d-b567-fc874ef59cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.633915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ddf49-16a2-440d-b567-fc874ef59cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.634194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ddf49-16a2-440d-b567-fc874ef59cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.634473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463ddf49-16a2-440d-b567-fc874ef59cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.635515 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ddf49-16a2-440d-b567-fc874ef59cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.638099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463ddf49-16a2-440d-b567-fc874ef59cd3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.640805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:03:52.653521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1115/2253] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:03:52.657486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:52.667490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f493f7f5-9069-4e75-b781-63c4a34a8b5f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.672483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.673132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.673407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.673677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] PATH_INFO: `/v3/projects/25659a61728b419cb48c7975bed8b00a/users/d50d11dfbae240a0aff25a1242db19b6/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.690836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25659a61728b419cb48c7975bed8b00a, user_id=d50d11dfbae240a0aff25a1242db19b6, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.693899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.708856 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1139/2254] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:03:52 2022] PUT /identity/v3/projects/25659a61728b419cb48c7975bed8b00a/users/d50d11dfbae240a0aff25a1242db19b6/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:03:52.719282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e082c-d452-4665-9c79-884536d0f9fc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.719567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e082c-d452-4665-9c79-884536d0f9fc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.719835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e082c-d452-4665-9c79-884536d0f9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.749264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dc0e082c-d452-4665-9c79-884536d0f9fc None None] MFA Rules not processed for user `d50d11dfbae240a0aff25a1242db19b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:52.750526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc0e082c-d452-4665-9c79-884536d0f9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:52.843294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1116/2255] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:03:52.854322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:52.857000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:52.924922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d9a93-ba09-4aa1-b520-e94856039515 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:52.928765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:52.929498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:52.930297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:52.930578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:52.943338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:52.944981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:52.955520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1140/2256] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:03:56.638836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649a7d4-5ee8-47ce-bcac-1ca0186d0a52 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:56.639326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649a7d4-5ee8-47ce-bcac-1ca0186d0a52 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:56.639423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649a7d4-5ee8-47ce-bcac-1ca0186d0a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:56.659074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c649a7d4-5ee8-47ce-bcac-1ca0186d0a52 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:03:56.660232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c649a7d4-5ee8-47ce-bcac-1ca0186d0a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:56.719486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1117/2257] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:03:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:03:56.733299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:03:56.734763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:03:56.817436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d64dc4-9eca-473b-8ba2-f1929ae90778 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:03:56.827521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97376b-c02e-4eca-b6a0-debd20d634ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:03:56.828295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97376b-c02e-4eca-b6a0-debd20d634ea service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:03:56.829072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97376b-c02e-4eca-b6a0-debd20d634ea service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:03:56.829072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97376b-c02e-4eca-b6a0-debd20d634ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:03:56.840971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97376b-c02e-4eca-b6a0-debd20d634ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:03:56.843221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97376b-c02e-4eca-b6a0-debd20d634ea service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:03:56.857202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1141/2258] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:03:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:04:03.865017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649a7d4-5ee8-47ce-bcac-1ca0186d0a52 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:04.015833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649a7d4-5ee8-47ce-bcac-1ca0186d0a52 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:04.022732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:04.023595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:04.024292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:04.024664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] PATH_INFO: `/v3/users/d50d11dfbae240a0aff25a1242db19b6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:04.026201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50d11dfbae240a0aff25a1242db19b6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:04.029194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:04.077240 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:04.098709 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50d11dfbae240a0aff25a1242db19b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:04.099898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50d11dfbae240a0aff25a1242db19b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:04.100576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50d11dfbae240a0aff25a1242db19b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:04.113388 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50d11dfbae240a0aff25a1242db19b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:04.134072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50d11dfbae240a0aff25a1242db19b6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:04.158125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1118/2259] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:04:03 2022] DELETE /identity/v3/users/d50d11dfbae240a0aff25a1242db19b6 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:04:04.164470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:04.165382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:04.165382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:04.188513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:04.189947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:04.259264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:04.324836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1142/2260] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:04.331722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:04.333340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:04.420576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b281d-9061-4761-83f1-9fbee72b322d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:04.427020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171bf99-d7d1-4591-9681-bc9efc8e2fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:04.427594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171bf99-d7d1-4591-9681-bc9efc8e2fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:04.428051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171bf99-d7d1-4591-9681-bc9efc8e2fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:04.428314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171bf99-d7d1-4591-9681-bc9efc8e2fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:04.445265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171bf99-d7d1-4591-9681-bc9efc8e2fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:04.446829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171bf99-d7d1-4591-9681-bc9efc8e2fa2 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:04.463335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1119/2261] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:04:04.970927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:04.973517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:04.994075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0b9d1-e9e7-4f8a-9477-6388571b0029 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:05.000458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:05.001068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.001416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.001723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] PATH_INFO: `/v3/projects/25659a61728b419cb48c7975bed8b00a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.003346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] RBAC: Authorizing `identity:delete_project(project_id=25659a61728b419cb48c7975bed8b00a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:05.005694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:05.107130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25659a61728b419cb48c7975bed8b00a', 'request_id': 'req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:05.118731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25659a61728b419cb48c7975bed8b00a', 'request_id': 'req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:05.130362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25659a61728b419cb48c7975bed8b00a', 'request_id': 'req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:05.154263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] The token cache is being invalidate because project 25659a61728b419cb48c7975bed8b00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:04:05.154926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:05.155853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4f07c2df-d1a0-4d04-a60f-b0b7a140beba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:05.158320 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1143/2262] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:04:04 2022] DELETE /identity/v3/projects/25659a61728b419cb48c7975bed8b00a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:04:05.166396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda9b3-5335-4696-9c8a-26a17766867b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.166396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda9b3-5335-4696-9c8a-26a17766867b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.167108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bda9b3-5335-4696-9c8a-26a17766867b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.203316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-02bda9b3-5335-4696-9c8a-26a17766867b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:05.204653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-02bda9b3-5335-4696-9c8a-26a17766867b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:05.304077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1120/2263] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:05.306261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10360-d38e-4558-8edd-6d3a88749b62 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.306764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10360-d38e-4558-8edd-6d3a88749b62 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.306855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10360-d38e-4558-8edd-6d3a88749b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.330319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-abe10360-d38e-4558-8edd-6d3a88749b62 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:05.331671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-abe10360-d38e-4558-8edd-6d3a88749b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:05.340772 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1144/2264] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:04:05.346121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bda9b3-5335-4696-9c8a-26a17766867b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:05.361871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bda9b3-5335-4696-9c8a-26a17766867b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:05.368775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:05.369710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.370135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.370545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.372168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:04:05.372644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:05.375221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:05.398377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1121/2265] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:04:05.399605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe10360-d38e-4558-8edd-6d3a88749b62 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:05.411497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe10360-d38e-4558-8edd-6d3a88749b62 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:05.419389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:05.421307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.422037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.422661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.423433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:05.425660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:05.493332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1145/2266] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:04:05 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:04:05.500861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:05.522014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8241c-a2bd-462a-ae8b-8740c423bbd4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:05.614387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:05.654277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:05.655081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.655362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.655642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.656409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:05.658699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:05.689957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1122/2267] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:04:05 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:04:05.694307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:05.710923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396536e8-5d76-4567-9853-bef319c3fd9a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:05.717977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:05.718731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.719065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.719414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.720215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:05.722035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:05.743001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1146/2268] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:04:05.744392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:05.756177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d92c78-1c15-4e63-8e14-83127208886d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:05.764635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd326d-cc60-4145-8c85-f960c041b96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:05.765560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd326d-cc60-4145-8c85-f960c041b96d admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.765875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd326d-cc60-4145-8c85-f960c041b96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.766176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd326d-cc60-4145-8c85-f960c041b96d admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.766856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd326d-cc60-4145-8c85-f960c041b96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:05.768800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd326d-cc60-4145-8c85-f960c041b96d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:05.782044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1123/2269] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:04:05.787190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:05.800802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e2959-f133-4f1a-b00a-5c2963145a31 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:05.811194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:05.812003 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.812324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.812636 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] PATH_INFO: `/v3/projects/111e9507d8af4bf49a1813e68e0c5f25/users/125cd1ca3426493d837e1683872a1138/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.842062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111e9507d8af4bf49a1813e68e0c5f25, user_id=125cd1ca3426493d837e1683872a1138, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:05.845371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:05.863762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1147/2270] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:04:05 2022] PUT /identity/v3/projects/111e9507d8af4bf49a1813e68e0c5f25/users/125cd1ca3426493d837e1683872a1138/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:04:05.869746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce255b-85ec-4666-af6b-7b00166dd56d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:05.870040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce255b-85ec-4666-af6b-7b00166dd56d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:05.870316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce255b-85ec-4666-af6b-7b00166dd56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:05.901227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-41ce255b-85ec-4666-af6b-7b00166dd56d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:05.901786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-41ce255b-85ec-4666-af6b-7b00166dd56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:06.000480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1124/2271] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:06.010579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:06.012807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:06.084826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:06.090836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a4304-d36e-481a-8e09-7214a110e662 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:06.103801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:06.104162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:06.104463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:06.112616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:06.124996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:06.126626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:06.139992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1148/2272] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:04:12.324925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff962fd0-e247-478d-951a-86bd73f7ebf4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:12.325693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff962fd0-e247-478d-951a-86bd73f7ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:12.326696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff962fd0-e247-478d-951a-86bd73f7ebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:12.387874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ff962fd0-e247-478d-951a-86bd73f7ebf4 None None] MFA Rules not processed for user `125cd1ca3426493d837e1683872a1138`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:12.391654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ff962fd0-e247-478d-951a-86bd73f7ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:12.486564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1125/2273] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:12.491640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:12.503102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03d512-56ff-414f-a679-ad92a6d8e396 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:12.507915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:12.508552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:12.508835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:12.509145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:12.509795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:12.512546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:12.545280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1149/2274] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:04:12 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:04:12.551978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff962fd0-e247-478d-951a-86bd73f7ebf4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:12.563634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff962fd0-e247-478d-951a-86bd73f7ebf4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:12.615253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:12.627476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:12.628272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:12.628560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:12.628833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:12.629477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:12.631445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:12.655826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1126/2275] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:04:12 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:04:12.659986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:12.672067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ff7af-a1d7-41c8-a66a-9644465522d3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:12.678618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:12.679351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:12.679627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:12.679928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:12.680743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:12.682916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:12.696702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1150/2276] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:04:12.702460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:12.714399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970ea72-81a3-4d39-abf6-e6016bb9ab20 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:12.719335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:12.719991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:12.720317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:12.720604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] PATH_INFO: `/v3/projects/10f5c0d085654153ab58943c035f79ad/users/8d186476fd484cebac1c4dc293d53d7b/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:12.736301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f5c0d085654153ab58943c035f79ad, user_id=8d186476fd484cebac1c4dc293d53d7b, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:12.738993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:12.754770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1127/2277] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:04:12 2022] PUT /identity/v3/projects/10f5c0d085654153ab58943c035f79ad/users/8d186476fd484cebac1c4dc293d53d7b/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:04:12.759197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:12.770862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5fdc7-e728-45b3-81a5-505ec2a9f8e1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:12.850632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e9bf4-2a65-48c8-b7d8-32f2dbd88f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:12.853035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9bf4-2a65-48c8-b7d8-32f2dbd88f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:12.853862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9bf4-2a65-48c8-b7d8-32f2dbd88f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:12.854330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e9bf4-2a65-48c8-b7d8-32f2dbd88f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:12.857351 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e9bf4-2a65-48c8-b7d8-32f2dbd88f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:12.860038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4e9bf4-2a65-48c8-b7d8-32f2dbd88f93 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:12.885415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1151/2278] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:04:12.892342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:12.917218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8ad37-577c-46f9-a1dd-43214c7b80b5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:12.928743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:12.937426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:12.938256 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:12.938766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] PATH_INFO: `/v3/projects/10f5c0d085654153ab58943c035f79ad/users/8d186476fd484cebac1c4dc293d53d7b/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:12.942718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f5c0d085654153ab58943c035f79ad, user_id=8d186476fd484cebac1c4dc293d53d7b, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:12.946390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:12.982849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1128/2279] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:04:12 2022] PUT /identity/v3/projects/10f5c0d085654153ab58943c035f79ad/users/8d186476fd484cebac1c4dc293d53d7b/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:04:17.840664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979de63-269d-463b-aa67-71fc748f9d98 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:17.841258 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979de63-269d-463b-aa67-71fc748f9d98 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:17.841405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979de63-269d-463b-aa67-71fc748f9d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:17.890480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0979de63-269d-463b-aa67-71fc748f9d98 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:17.893964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0979de63-269d-463b-aa67-71fc748f9d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:18.060853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1152/2280] 10.222.0.50 () {58 vars in 967 bytes} [Wed Sep 14 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:04:18.082776 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:18.087660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:18.242668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940cd80-e944-452b-8ec1-9b2f5f7f23b9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:18.249985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:18.251149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:18.251261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:18.251780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:18.266159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:18.268489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:18.281102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1129/2281] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:04:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 13:04:20.860558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:20.861122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:20.861122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:20.904474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] MFA Rules not processed for user `8d186476fd484cebac1c4dc293d53d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:20.904474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:20.960826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:20.987334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1153/2282] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:21.002385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:21.012604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:21.113637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa348d8-688a-4c35-ad8e-dad69ba08428 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:21.119913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053f216-de9f-4ad5-9b33-e9a7df8145f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:21.121353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053f216-de9f-4ad5-9b33-e9a7df8145f2 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:21.121801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053f216-de9f-4ad5-9b33-e9a7df8145f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:21.122201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053f216-de9f-4ad5-9b33-e9a7df8145f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:21.159216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:21.196351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053f216-de9f-4ad5-9b33-e9a7df8145f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:21.198072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053f216-de9f-4ad5-9b33-e9a7df8145f2 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:21.210460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1130/2283] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:04:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:04:21.341328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:21.343361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:21.467361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f96a9a-999f-4a3e-a439-e0f59735b4cc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:21.478957 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb0e98-78f8-4185-a7d6-e077c38162d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:21.481204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0e98-78f8-4185-a7d6-e077c38162d5 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:21.481558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0e98-78f8-4185-a7d6-e077c38162d5 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:21.481844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb0e98-78f8-4185-a7d6-e077c38162d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:21.484425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ffeb0e98-78f8-4185-a7d6-e077c38162d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:21.504620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb0e98-78f8-4185-a7d6-e077c38162d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:21.507461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb0e98-78f8-4185-a7d6-e077c38162d5 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:21.520540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1154/2284] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:04:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:04:23.000039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f1872-515b-457d-b34e-d02bba79588f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:23.003308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f1872-515b-457d-b34e-d02bba79588f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:23.003308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f1872-515b-457d-b34e-d02bba79588f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:23.031642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8d5f1872-515b-457d-b34e-d02bba79588f None None] MFA Rules not processed for user `125cd1ca3426493d837e1683872a1138`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:23.031642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8d5f1872-515b-457d-b34e-d02bba79588f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:23.047472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1131/2285] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:23.542990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a640c3-e01e-4e80-a048-575f0f77bbf0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:23.543541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a640c3-e01e-4e80-a048-575f0f77bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:23.543968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a640c3-e01e-4e80-a048-575f0f77bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:23.580706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-14a640c3-e01e-4e80-a048-575f0f77bbf0 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:23.593617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-14a640c3-e01e-4e80-a048-575f0f77bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:23.614235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1155/2286] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:23.652805 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f1872-515b-457d-b34e-d02bba79588f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:23.677259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f1872-515b-457d-b34e-d02bba79588f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:23.686166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:23.686950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:23.687261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:23.687635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:23.704069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:23.706209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:23.719625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1132/2287] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:04:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:04:24.469584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3251-2897-4b66-9e76-ecfffe75c5ac None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:24.470389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3251-2897-4b66-9e76-ecfffe75c5ac None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:24.470549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa3251-2897-4b66-9e76-ecfffe75c5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:24.494992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4ffa3251-2897-4b66-9e76-ecfffe75c5ac None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:24.498664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4ffa3251-2897-4b66-9e76-ecfffe75c5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:24.523640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1156/2288] 10.222.0.50 () {58 vars in 967 bytes} [Wed Sep 14 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:24.538175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:24.551520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cbe8c-ec12-4d38-8d23-b6359be69bef service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:24.561123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:24.562082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:24.562603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:24.562933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:24.573744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:24.575841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:24.588248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1133/2289] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:04:24.905307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405c3f-b4df-42a2-a14f-65b19b160d06 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:24.906169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405c3f-b4df-42a2-a14f-65b19b160d06 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:24.906626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405c3f-b4df-42a2-a14f-65b19b160d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:24.933655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-64405c3f-b4df-42a2-a14f-65b19b160d06 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:24.936347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-64405c3f-b4df-42a2-a14f-65b19b160d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:24.949265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1157/2290] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:04:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:04:24.968969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:24.987094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2635efd-fcfb-4e96-af5b-b42962bef225 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:24.999450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065054cc-3ad2-4ea9-b142-8fedef57469c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:25.000198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065054cc-3ad2-4ea9-b142-8fedef57469c service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:25.000445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065054cc-3ad2-4ea9-b142-8fedef57469c service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:25.000717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065054cc-3ad2-4ea9-b142-8fedef57469c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:25.012668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065054cc-3ad2-4ea9-b142-8fedef57469c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:25.015229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065054cc-3ad2-4ea9-b142-8fedef57469c service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:25.026372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1134/2291] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:04:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:04:25.278258 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c2bf-30c5-45da-9675-34dd8e8acaac None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:25.278573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c2bf-30c5-45da-9675-34dd8e8acaac None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:25.278678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c2bf-30c5-45da-9675-34dd8e8acaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:25.302842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9e35c2bf-30c5-45da-9675-34dd8e8acaac None None] MFA Rules not processed for user `11bec778cbcb4e59a4d57027c9a9f935`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:25.304712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9e35c2bf-30c5-45da-9675-34dd8e8acaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:25.400610 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1158/2292] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:25.476706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:25.476991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:25.477445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:25.499839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:25.501922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:25.511414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1135/2293] 10.222.0.50 () {58 vars in 967 bytes} [Wed Sep 14 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:25.525822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35c2bf-30c5-45da-9675-34dd8e8acaac None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:25.542329 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35c2bf-30c5-45da-9675-34dd8e8acaac None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:25.548288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa252d62-ca2d-41a2-9ff0-1c8f5743cdd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:25.548929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252d62-ca2d-41a2-9ff0-1c8f5743cdd1 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:25.549212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252d62-ca2d-41a2-9ff0-1c8f5743cdd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:25.549486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa252d62-ca2d-41a2-9ff0-1c8f5743cdd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:25.559486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252d62-ca2d-41a2-9ff0-1c8f5743cdd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:25.561284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa252d62-ca2d-41a2-9ff0-1c8f5743cdd1 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:25.570464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1159/2294] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:04:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:04:28.357898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:28.359423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:28.449702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11b9d-ada9-49a6-a3a9-6b65833a06ce None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:28.454541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:28.455185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:28.455466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:28.455741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] PATH_INFO: `/v3/users/a0eae33ec289448d81c0ffc5d30d84a1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:28.456914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0eae33ec289448d81c0ffc5d30d84a1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:28.460219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:28.517471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0eae33ec289448d81c0ffc5d30d84a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:28.519033 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0eae33ec289448d81c0ffc5d30d84a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:28.519702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0eae33ec289448d81c0ffc5d30d84a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:28.528135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0eae33ec289448d81c0ffc5d30d84a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:28.540198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0eae33ec289448d81c0ffc5d30d84a1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:28.543974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:28.557199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1136/2295] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:04:28 2022] DELETE /identity/v3/users/a0eae33ec289448d81c0ffc5d30d84a1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:04:28.562285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:28.562946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:28.562946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:28.582945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:28.584288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:28.639552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:28.659057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1160/2296] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:28.669565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:28.671176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:28.742367 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53844a00-7f3f-41d3-9505-fa40f35e91cc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:28.747191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4a112-999c-4ae8-8e84-604cbab8b4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:28.747812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a112-999c-4ae8-8e84-604cbab8b4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:28.748135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a112-999c-4ae8-8e84-604cbab8b4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:28.748406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a112-999c-4ae8-8e84-604cbab8b4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:28.758808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4a112-999c-4ae8-8e84-604cbab8b4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:28.760284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4a112-999c-4ae8-8e84-604cbab8b4b8 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:28.772290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1137/2297] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:04:28.988913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:28.990538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:29.004724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660ace3-f2ea-4c49-b095-135518b4374f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:29.011867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:29.012785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:29.013279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:29.013743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] PATH_INFO: `/v3/projects/101ad244a4624d32972b0d9e62d0422e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:29.015357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] RBAC: Authorizing `identity:delete_project(project_id=101ad244a4624d32972b0d9e62d0422e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:29.017524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:29.084974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101ad244a4624d32972b0d9e62d0422e', 'request_id': 'req-930fa03b-6225-4337-9a17-d13e5c68664c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:29.093162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101ad244a4624d32972b0d9e62d0422e', 'request_id': 'req-930fa03b-6225-4337-9a17-d13e5c68664c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:29.104842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101ad244a4624d32972b0d9e62d0422e', 'request_id': 'req-930fa03b-6225-4337-9a17-d13e5c68664c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:29.119254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] The token cache is being invalidate because project 101ad244a4624d32972b0d9e62d0422e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:04:29.119551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:29.120814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:04:29.124657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1161/2298] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:04:28 2022] DELETE /identity/v3/projects/101ad244a4624d32972b0d9e62d0422e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:04:38.767309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=28 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:39.115955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:04:45.508383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d104bbd-70d0-490d-8870-f6407a58741f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:45.508930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d104bbd-70d0-490d-8870-f6407a58741f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:45.508930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d104bbd-70d0-490d-8870-f6407a58741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:45.531568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4d104bbd-70d0-490d-8870-f6407a58741f None None] MFA Rules not processed for user `33ba92af52134e7aadd45d4503bb0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:04:45.532811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4d104bbd-70d0-490d-8870-f6407a58741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:45.596466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1138/2299] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:04:55.040378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:04:55.042009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:55.117145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fa03b-6225-4337-9a17-d13e5c68664c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:04:55.120940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb123-1463-4a81-b1f6-d2a17ceed12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:04:55.122403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb123-1463-4a81-b1f6-d2a17ceed12e service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:04:55.122849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb123-1463-4a81-b1f6-d2a17ceed12e service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:04:55.123178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb123-1463-4a81-b1f6-d2a17ceed12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:04:55.125108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-af5eb123-1463-4a81-b1f6-d2a17ceed12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:04:55.205319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eb123-1463-4a81-b1f6-d2a17ceed12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:04:55.206769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eb123-1463-4a81-b1f6-d2a17ceed12e service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:04:55.217559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1162/2300] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:04:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:04:55.587314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=25 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:05:05.212508 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=50 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:05:17.677920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ef6f-ef9c-4d8f-8928-f6849ea8ac53 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:05:17.678501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ef6f-ef9c-4d8f-8928-f6849ea8ac53 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:05:17.678501 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825ef6f-ef9c-4d8f-8928-f6849ea8ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:05:17.701139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c825ef6f-ef9c-4d8f-8928-f6849ea8ac53 None None] MFA Rules not processed for user `df16e3ecae574db7a79d7a1d5b825336`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:05:17.703105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c825ef6f-ef9c-4d8f-8928-f6849ea8ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:05:17.771652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1139/2301] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:05:27.764121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=25 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:05:47.643608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b542-425f-49ad-9780-cf98aa97dce5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:05:47.644331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b542-425f-49ad-9780-cf98aa97dce5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:05:47.644331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87b542-425f-49ad-9780-cf98aa97dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:05:47.663369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8c87b542-425f-49ad-9780-cf98aa97dce5 None None] MFA Rules not processed for user `35facb0f8769456d86fc13db4be34dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:05:47.664611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c87b542-425f-49ad-9780-cf98aa97dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:05:47.723052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1163/2302] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:05:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:05:57.716041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=25 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:05:58.491101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e477-2329-47be-b115-722348f92a40 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:05:58.491977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e477-2329-47be-b115-722348f92a40 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:05:58.491977 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013e477-2329-47be-b115-722348f92a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:05:58.513764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b013e477-2329-47be-b115-722348f92a40 None None] MFA Rules not processed for user `11bec778cbcb4e59a4d57027c9a9f935`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:05:58.515359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b013e477-2329-47be-b115-722348f92a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:05:58.585296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1140/2303] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:05:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:06:00.905362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:00.905924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:00.905924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:00.925366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] MFA Rules not processed for user `33ba92af52134e7aadd45d4503bb0b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:06:00.926571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:00.933466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1164/2304] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:06:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:06:08.575744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=25 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:06:10.919883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:06:21.890181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e477-2329-47be-b115-722348f92a40 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:21.900761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013e477-2329-47be-b115-722348f92a40 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:21.905615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:21.906236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:21.906521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:21.906813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:21.908663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:21.985937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:21.987397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:22.000482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1141/2305] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:06:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:06:25.599669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:25.601135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:25.615268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a32238-0eb0-4ea3-b592-11087762bbe0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:25.619181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cfb84-ab6e-416d-86ca-dddf70af09d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:25.619831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfb84-ab6e-416d-86ca-dddf70af09d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:25.620140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfb84-ab6e-416d-86ca-dddf70af09d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:25.620417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cfb84-ab6e-416d-86ca-dddf70af09d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:25.622854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b38cfb84-ab6e-416d-86ca-dddf70af09d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:25.639705 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cfb84-ab6e-416d-86ca-dddf70af09d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:25.641241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cfb84-ab6e-416d-86ca-dddf70af09d0 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:25.657703 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1165/2306] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:06:30.401035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:30.402795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:30.417444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190bd9f1-5eca-4ef4-9326-e7fe6fb4dee1 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:30.423560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:30.424179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:30.424461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:30.424732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:30.426415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:30.438219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:30.439811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:30.450309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1142/2307] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:06:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:06:35.651676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:06:38.731563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:38.732381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:38.732381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:38.754646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:06:38.755959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:38.842887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1166/2308] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:06:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:06:38.923423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:38.925962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:39.077415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bbeb4-c279-4c4f-a41b-5d1618e47670 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:39.085701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:39.086557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:39.086920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:39.087097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:39.097901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:39.099839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:39.136044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1143/2309] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:06:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:06:42.796634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:42.801743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:42.835804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b8d34-c2bf-4b6c-ab76-502cc44bf02d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:42.843056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd785ff-894b-4ec1-93a8-643d327fc578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:42.843763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd785ff-894b-4ec1-93a8-643d327fc578 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:42.844069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd785ff-894b-4ec1-93a8-643d327fc578 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:42.844349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd785ff-894b-4ec1-93a8-643d327fc578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:42.846641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4dd785ff-894b-4ec1-93a8-643d327fc578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:42.870291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd785ff-894b-4ec1-93a8-643d327fc578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:42.872827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd785ff-894b-4ec1-93a8-643d327fc578 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:42.885047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1167/2310] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:06:49.110107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=72 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:06:52.019726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:52.030479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f247a-6633-4940-b558-3063ad4a82c5 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:52.035358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fb6de-c155-45ae-9c04-db6fd84e2e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:52.036221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb6de-c155-45ae-9c04-db6fd84e2e51 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:52.036442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb6de-c155-45ae-9c04-db6fd84e2e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:52.036714 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fb6de-c155-45ae-9c04-db6fd84e2e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:52.038604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1a4fb6de-c155-45ae-9c04-db6fd84e2e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:52.051202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fb6de-c155-45ae-9c04-db6fd84e2e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:52.052751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fb6de-c155-45ae-9c04-db6fd84e2e51 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:52.065859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1144/2311] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:06:52.879112 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=31 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:06:59.547443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9fef7-8b85-4a5c-b0a7-df421411dbfd None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.548160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9fef7-8b85-4a5c-b0a7-df421411dbfd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.548160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9fef7-8b85-4a5c-b0a7-df421411dbfd None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.549744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1168/2312] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:06:59.557055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00005b-17d5-4929-a762-bdd28c3447e0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.558146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00005b-17d5-4929-a762-bdd28c3447e0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.558146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00005b-17d5-4929-a762-bdd28c3447e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.581319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-be00005b-17d5-4929-a762-bdd28c3447e0 None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:06:59.582876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-be00005b-17d5-4929-a762-bdd28c3447e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:59.593518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1145/2313] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:06:59.607804 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9fef7-8b85-4a5c-b0a7-df421411dbfd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:59.610465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2ce9fef7-8b85-4a5c-b0a7-df421411dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:59.691161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9fef7-8b85-4a5c-b0a7-df421411dbfd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:59.694870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c781e39-6676-4cb6-aa33-3e60b7855d25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:59.695639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c781e39-6676-4cb6-aa33-3e60b7855d25 service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.696033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c781e39-6676-4cb6-aa33-3e60b7855d25 service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.696378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c781e39-6676-4cb6-aa33-3e60b7855d25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.708227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c781e39-6676-4cb6-aa33-3e60b7855d25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:59.709728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c781e39-6676-4cb6-aa33-3e60b7855d25 service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:59.722450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1169/2314] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:06:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:06:59.796326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1d0de-b488-43b2-9833-07346178dae1 None None] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.796638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1d0de-b488-43b2-9833-07346178dae1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.796909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1d0de-b488-43b2-9833-07346178dae1 None None] PATH_INFO: `/` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.798266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1146/2315] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:06:59.802978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af28a9-42b7-4894-8be2-437742932ea8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.803297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af28a9-42b7-4894-8be2-437742932ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.803573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af28a9-42b7-4894-8be2-437742932ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.825033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-97af28a9-42b7-4894-8be2-437742932ea8 None None] MFA Rules not processed for user `f5ca117fa96d412e9bda506591a01fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:06:59.826283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-97af28a9-42b7-4894-8be2-437742932ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:06:59.832971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1170/2316] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:06:59.844824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1d0de-b488-43b2-9833-07346178dae1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:06:59.855984 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1d0de-b488-43b2-9833-07346178dae1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:06:59.859697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb526397-899e-44e6-b3e7-b7b1997c0095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:06:59.860330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526397-899e-44e6-b3e7-b7b1997c0095 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.860608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526397-899e-44e6-b3e7-b7b1997c0095 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.860873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb526397-899e-44e6-b3e7-b7b1997c0095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.868527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb526397-899e-44e6-b3e7-b7b1997c0095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:06:59.869948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb526397-899e-44e6-b3e7-b7b1997c0095 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:06:59.878571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1147/2317] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:06:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:06:59.963875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae9d8c-85de-42f0-831c-24f90e4edbb2 None None] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.964187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae9d8c-85de-42f0-831c-24f90e4edbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.964460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae9d8c-85de-42f0-831c-24f90e4edbb2 None None] PATH_INFO: `/` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.965775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1171/2318] 10.222.0.50 () {54 vars in 921 bytes} [Wed Sep 14 13:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 14 13:06:59.970712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:06:59.970998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:06:59.971272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:06:59.992729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] MFA Rules not processed for user `3faaacdf2ff54c06bb4eebf13533a72a`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:06:59.993947 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:00.004084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1148/2319] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Sep 14 13:06:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:00.022110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae9d8c-85de-42f0-831c-24f90e4edbb2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:00.033741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae9d8c-85de-42f0-831c-24f90e4edbb2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:00.037380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:00.037963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:00.038235 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:00.038502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:00.049645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:00.051124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:00.063748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1172/2320] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:00.129554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:00.132245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:00.210720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb269c-cb92-4cb9-b9be-530e75779b1f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:00.217305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:00.218019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:00.218295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:00.218643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:00.220822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:00.234299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:00.235888 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:00.249968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1149/2321] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:03.305595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:03.319297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202be6de-4bb0-4c47-abf0-f00431d3f49d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:03.326129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:03.326811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:03.327232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:03.327571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:03.329371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:03.341450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:03.343034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:03.352599 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1173/2322] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:05.469957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:05.494258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9beeda4-f050-4334-9344-4e519e85078e service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:05.511975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b94451-82f4-48ec-b35c-bb5153de61d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:05.512924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94451-82f4-48ec-b35c-bb5153de61d0 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:05.513371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94451-82f4-48ec-b35c-bb5153de61d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:05.513829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b94451-82f4-48ec-b35c-bb5153de61d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:05.521682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-90b94451-82f4-48ec-b35c-bb5153de61d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:05.539462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b94451-82f4-48ec-b35c-bb5153de61d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:05.543847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b94451-82f4-48ec-b35c-bb5153de61d0 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:05.564720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1150/2323] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:06.208554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:06.220701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5d41-d3e5-4fd9-918a-d356489034d9 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:06.226998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:06.227613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:06.228125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:06.228346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:06.230908 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:06.243902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:06.246251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:06.257811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1174/2324] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:07.780343 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:07.781442 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:07.786810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:07.847661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:07.850167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:07.862845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1151/2325] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:07.878066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:07.893157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567aba34-5cb2-4eb0-b7cd-f2908d764d71 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:07.898660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:07.899328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:07.899935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:07.900327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:07.910846 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:07.912573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:07.923768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1175/2326] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:07:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:07:13.717386 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:13.718949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:13.886121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a8bbf-d2f6-49d2-9176-2ea2d0f2b4f1 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:13.894148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:13.894784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:13.895066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:13.895352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] PATH_INFO: `/v3/users/11bec778cbcb4e59a4d57027c9a9f935` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:13.896617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bec778cbcb4e59a4d57027c9a9f935)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:13.898753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:13.958901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:13.991764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bec778cbcb4e59a4d57027c9a9f935'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:13.992657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bec778cbcb4e59a4d57027c9a9f935'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:13.993832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bec778cbcb4e59a4d57027c9a9f935'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.007125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bec778cbcb4e59a4d57027c9a9f935'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.031507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-79840512-cf30-40e6-8387-07ae08e8cf20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bec778cbcb4e59a4d57027c9a9f935'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.064138 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1152/2327] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:13 2022] DELETE /identity/v3/users/11bec778cbcb4e59a4d57027c9a9f935 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:14.340458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:14.375785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc08f82-d308-4472-b612-e8f895574a33 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:14.469620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:14.470861 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:14.471382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:14.471742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] PATH_INFO: `/v3/projects/847d8691292c496da7a29a8ca6850cb5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:14.473209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=847d8691292c496da7a29a8ca6850cb5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:14.475386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:14.584719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:14.593183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847d8691292c496da7a29a8ca6850cb5', 'request_id': 'req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.617264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847d8691292c496da7a29a8ca6850cb5', 'request_id': 'req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.627283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847d8691292c496da7a29a8ca6850cb5', 'request_id': 'req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.649692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] The token cache is being invalidate because project 847d8691292c496da7a29a8ca6850cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:14.650159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.651981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-279cbe72-8fe9-4ed4-97b3-4cd9909a0e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:14.662121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:14.662566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1176/2328] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:14 2022] DELETE /identity/v3/projects/847d8691292c496da7a29a8ca6850cb5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:14.663131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:14.663332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:14.701525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:14.702775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:14.820221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1153/2329] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:14.821791 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd7192-8f98-4bab-80db-40fe09526199 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:14.822119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd7192-8f98-4bab-80db-40fe09526199 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:14.822406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd7192-8f98-4bab-80db-40fe09526199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:14.865473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aedd7192-8f98-4bab-80db-40fe09526199 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:14.866941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aedd7192-8f98-4bab-80db-40fe09526199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:14.867952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:14.869652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:14.880154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1177/2330] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:14.884163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd7192-8f98-4bab-80db-40fe09526199 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:14.896166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd7192-8f98-4bab-80db-40fe09526199 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:14.903317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:14.903978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:14.904307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:14.904637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:14.905297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:14.905640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:14.907227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:14.921299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1178/2331] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:07:14.926720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:14.939267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33517098-b139-4f7f-966b-c16cc24fa54c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:14.945927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:14.946709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:14.946991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:14.947344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:14.948556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:14.950900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:14.977815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f2300-2b40-498d-a3e0-616d34341147 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:14.981973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:14.982693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:14.983048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:14.983402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:14.985545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:14.995799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1179/2332] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:14 2022] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:15.000167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:15.008834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:15.010404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:15.023435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1154/2333] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:15.113600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb846633-2f5b-4af5-b0b0-dfe2294444ce admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:15.120896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:15.122161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:15.122534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:15.122903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:15.123809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:15.126933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:15.168838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1180/2334] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:14 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:15.169967 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:15.189052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7e906-e6ce-4719-bf90-cd9c463428c6 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:15.194200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:15.195053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:15.195589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:15.196434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:15.197421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:15.200630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:15.215418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1155/2335] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:15.219767 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:15.231507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ade589-1195-48be-8805-22f55ba8d839 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:15.237030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56159f1-7745-4b96-8f7f-b358b4d38844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:15.237660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56159f1-7745-4b96-8f7f-b358b4d38844 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:15.237944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56159f1-7745-4b96-8f7f-b358b4d38844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:15.238221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56159f1-7745-4b96-8f7f-b358b4d38844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:15.238882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56159f1-7745-4b96-8f7f-b358b4d38844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:15.240682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56159f1-7745-4b96-8f7f-b358b4d38844 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:15.253919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1181/2336] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:15.258332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:15.271007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56778c-54c3-4afc-ba66-4f68744aad9c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:15.277318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:15.278026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:15.278319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:15.278632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] PATH_INFO: `/v3/projects/1df94afc7baf41cab539b5664d2e211a/users/81156a2dfbe24caf914f4c48a3856ff9/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:15.299408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df94afc7baf41cab539b5664d2e211a, user_id=81156a2dfbe24caf914f4c48a3856ff9, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:15.302150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:15.322630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1156/2337] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:15 2022] PUT /identity/v3/projects/1df94afc7baf41cab539b5664d2e211a/users/81156a2dfbe24caf914f4c48a3856ff9/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:15.328568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a881-a131-4511-9f69-d3b650421b88 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:15.328895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a881-a131-4511-9f69-d3b650421b88 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:15.329558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55a881-a131-4511-9f69-d3b650421b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:15.350769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1e55a881-a131-4511-9f69-d3b650421b88 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:15.352006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1e55a881-a131-4511-9f69-d3b650421b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:15.469442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1182/2338] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:15.480727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:15.482642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:15.517441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:15.583326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc0c5e-063b-4fbc-b9df-8c063ec15a85 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:15.587601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:15.588346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:15.589214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:15.589719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:15.600872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:15.602793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:15.616002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1157/2339] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:17.057185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5d57-925c-4b94-bc5b-5e572d735fcd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:17.058450 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5d57-925c-4b94-bc5b-5e572d735fcd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:17.059421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e5d57-925c-4b94-bc5b-5e572d735fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:17.123688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:17.154915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aa8e5d57-925c-4b94-bc5b-5e572d735fcd None None] MFA Rules not processed for user `81156a2dfbe24caf914f4c48a3856ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:17.157198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aa8e5d57-925c-4b94-bc5b-5e572d735fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:17.255578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1183/2340] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:17.259972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:17.271400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d48c4-48f5-4eb1-b279-1d7aac480a67 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:17.277411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:17.278021 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:17.278322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:17.278599 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:17.279244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:17.281547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:17.335659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1158/2341] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:17 2022] POST /identity/v3/projects => generated 403 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:17.337025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e5d57-925c-4b94-bc5b-5e572d735fcd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:17.375832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e5d57-925c-4b94-bc5b-5e572d735fcd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:17.468689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:17.469315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:17.469592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:17.470003 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:17.471034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:17.472611 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:17.503212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1184/2342] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:17 2022] POST /identity/v3/users => generated 308 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:17.507948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:17.528665 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0151c-d2c2-4dd7-a4d3-1d8b5508ca19 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:17.535273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:17.536143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:17.536526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:17.536921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:17.537892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:17.540102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:17.553315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1159/2343] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:17.557656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:17.567777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af1ff6-2343-46e3-8cda-6fb5109603f5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:17.572676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:17.573699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:17.573979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:17.574255 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] PATH_INFO: `/v3/projects/800d840acd214552add9b35a6cbd765d/users/cee0a4d03a4145398a722d1892559e92/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:17.594099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] RBAC: Authorizing `identity:create_grant(project_id=800d840acd214552add9b35a6cbd765d, user_id=cee0a4d03a4145398a722d1892559e92, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:17.596869 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:17.613988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1185/2344] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:17 2022] PUT /identity/v3/projects/800d840acd214552add9b35a6cbd765d/users/cee0a4d03a4145398a722d1892559e92/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:17.617885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:17.632070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5da77-66a4-4c85-9fb1-aec0c799b9d3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:17.708869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cb6a4-6b49-4dba-9d23-1b27807289a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:17.708869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb6a4-6b49-4dba-9d23-1b27807289a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:17.708869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb6a4-6b49-4dba-9d23-1b27807289a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:17.709309 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cb6a4-6b49-4dba-9d23-1b27807289a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:17.709650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cb6a4-6b49-4dba-9d23-1b27807289a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:17.712107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cb6a4-6b49-4dba-9d23-1b27807289a2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:17.726557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1160/2345] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:17.731280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:17.742417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a371ac-177f-47b1-809f-30baf14f108e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:17.748402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:17.749220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:17.749569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:17.749896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] PATH_INFO: `/v3/projects/800d840acd214552add9b35a6cbd765d/users/cee0a4d03a4145398a722d1892559e92/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:17.752127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=800d840acd214552add9b35a6cbd765d, user_id=cee0a4d03a4145398a722d1892559e92, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:17.755066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:17.768716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1186/2346] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:17 2022] PUT /identity/v3/projects/800d840acd214552add9b35a6cbd765d/users/cee0a4d03a4145398a722d1892559e92/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:19.216440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:19.216959 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:19.217058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:19.269286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] MFA Rules not processed for user `cee0a4d03a4145398a722d1892559e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:19.270505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:19.418822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1161/2347] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:21.132692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:21.135850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:21.176795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:21.185541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:21.245861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:21.340653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:21.379261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94898a9d-3477-4d2d-8860-f74f1806e8ce admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:21.395896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:21.397301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:21.397590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:21.397873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:21.404544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:21.406468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f24ae-e2d7-4c9d-8209-fc19aee57d07 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:21.413529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:21.414583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:21.415049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:21.415732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] PATH_INFO: `/v3/users/35facb0f8769456d86fc13db4be34dd4` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:21.418097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35facb0f8769456d86fc13db4be34dd4)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:21.421552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:21.426728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:21.429067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:21.445649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1187/2348] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:21.446560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:21.460472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ea1a-b5b5-4095-adca-1cdf2daeb539 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:21.472586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:21.473661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:21.475287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:21.475569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] PATH_INFO: `/v3/users/81156a2dfbe24caf914f4c48a3856ff9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:21.477478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81156a2dfbe24caf914f4c48a3856ff9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:21.481891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:21.520346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35facb0f8769456d86fc13db4be34dd4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.521424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35facb0f8769456d86fc13db4be34dd4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.522116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35facb0f8769456d86fc13db4be34dd4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.539287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35facb0f8769456d86fc13db4be34dd4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.562621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35facb0f8769456d86fc13db4be34dd4'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.586740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1162/2349] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:21 2022] DELETE /identity/v3/users/35facb0f8769456d86fc13db4be34dd4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:21.594565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81156a2dfbe24caf914f4c48a3856ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.595356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81156a2dfbe24caf914f4c48a3856ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.596633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81156a2dfbe24caf914f4c48a3856ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.605948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81156a2dfbe24caf914f4c48a3856ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.633166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81156a2dfbe24caf914f4c48a3856ff9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:21.658330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1188/2350] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:21 2022] DELETE /identity/v3/users/81156a2dfbe24caf914f4c48a3856ff9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:21.959141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:21.963825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:22.073282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:22.074913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:22.085865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91eac1b-07a0-4ba8-bcf0-ce7d1643c910 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:22.140717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:22.177909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9cb7a-547e-41ad-9dcc-58f82a655c36 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:22.180471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:22.181394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:22.181750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:22.182127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] PATH_INFO: `/v3/projects/1df94afc7baf41cab539b5664d2e211a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:22.182996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:22.183593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df94afc7baf41cab539b5664d2e211a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:22.183713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:22.183890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:22.184717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] PATH_INFO: `/v3/projects/66e28aeec3aa4b829924ae12a81a94a5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:22.185317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e28aeec3aa4b829924ae12a81a94a5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:22.186095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:22.187326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:22.253497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e28aeec3aa4b829924ae12a81a94a5', 'request_id': 'req-27797651-c592-48b0-9aed-55ac665c4804'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.256375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:22.282521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e28aeec3aa4b829924ae12a81a94a5', 'request_id': 'req-27797651-c592-48b0-9aed-55ac665c4804'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.304158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e28aeec3aa4b829924ae12a81a94a5', 'request_id': 'req-27797651-c592-48b0-9aed-55ac665c4804'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.309088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df94afc7baf41cab539b5664d2e211a', 'request_id': 'req-a020e857-27e8-435b-849b-a49fc3b3d77d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.325228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df94afc7baf41cab539b5664d2e211a', 'request_id': 'req-a020e857-27e8-435b-849b-a49fc3b3d77d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.336909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] The token cache is being invalidate because project 66e28aeec3aa4b829924ae12a81a94a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:22.337204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.338248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-27797651-c592-48b0-9aed-55ac665c4804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.341937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1189/2351] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:22 2022] DELETE /identity/v3/projects/66e28aeec3aa4b829924ae12a81a94a5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:22.347669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405e4c-3891-41a1-98b9-68b24663caea None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:22.350199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df94afc7baf41cab539b5664d2e211a', 'request_id': 'req-a020e857-27e8-435b-849b-a49fc3b3d77d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.352179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405e4c-3891-41a1-98b9-68b24663caea None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:22.354491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405e4c-3891-41a1-98b9-68b24663caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:22.378157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] The token cache is being invalidate because project 1df94afc7baf41cab539b5664d2e211a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:22.378942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.381691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.396128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1163/2352] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:21 2022] DELETE /identity/v3/projects/1df94afc7baf41cab539b5664d2e211a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:22.397254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:22.399060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:22.423377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c5405e4c-3891-41a1-98b9-68b24663caea None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:22.428360 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c5405e4c-3891-41a1-98b9-68b24663caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:22.567845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1190/2353] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:22.577544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ff152-5c9f-4f92-8273-2b49ef4e4f1a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:22.577860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ff152-5c9f-4f92-8273-2b49ef4e4f1a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:22.578746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455ff152-5c9f-4f92-8273-2b49ef4e4f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:22.581238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020e857-27e8-435b-849b-a49fc3b3d77d admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:22.590401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:22.591058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:22.591446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:22.591727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] PATH_INFO: `/v3/users/cee0a4d03a4145398a722d1892559e92` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:22.592937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee0a4d03a4145398a722d1892559e92)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:22.597268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:22.601972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-455ff152-5c9f-4f92-8273-2b49ef4e4f1a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:22.603334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-455ff152-5c9f-4f92-8273-2b49ef4e4f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:22.615882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1191/2354] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:22.616849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ff152-5c9f-4f92-8273-2b49ef4e4f1a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:22.632956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455ff152-5c9f-4f92-8273-2b49ef4e4f1a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:22.647312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:22.647937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:22.648268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:22.648651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:22.649181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:22.649597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:22.652158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:22.673728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1192/2355] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:22.677818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:22.692295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee0a4d03a4145398a722d1892559e92'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.693505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee0a4d03a4145398a722d1892559e92'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.694252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008406e-cb8c-4757-9054-6a3814fa9131 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:22.696652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee0a4d03a4145398a722d1892559e92'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.704071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:22.704071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:22.704071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:22.704638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:22.704941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:22.705594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee0a4d03a4145398a722d1892559e92'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.706830 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:22.720104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:22.731724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee0a4d03a4145398a722d1892559e92'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:22.744561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1193/2356] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:22 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:22.751416 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:22.754490 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1164/2357] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:22 2022] DELETE /identity/v3/users/cee0a4d03a4145398a722d1892559e92 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:22.756853 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:22.876056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe2a23-4dde-4c6e-84fa-f10f30d792e2 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:22.978850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:23.035277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.035929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.036238 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.036569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.037547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.046152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.115594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1194/2358] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:22 2022] POST /identity/v3/users => generated 291 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:23.116927 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.135080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5ea8-8439-49bc-ac99-1316ff88a894 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.148615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.149614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.149996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.150403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.152630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.157024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.157423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.159348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:23.174999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2002d4-0303-4f9a-85cf-0764c4bc970b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.187696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.193950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.195417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.195782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] PATH_INFO: `/v3/projects/800d840acd214552add9b35a6cbd765d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.198643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=800d840acd214552add9b35a6cbd765d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.203741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.214608 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1165/2359] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:23.216755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.234058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce90c7a-7d59-4082-a263-92d5f75ba4ea admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.239941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.240980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.241601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.242594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.243579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.246056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.263919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1166/2360] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:23.268144 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.283966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdb230-2ba0-4f71-91d9-d6ef35c3d759 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.290347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5d37b-30b3-40a5-98bc-3b022dd98009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.292422 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d37b-30b3-40a5-98bc-3b022dd98009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.292896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d37b-30b3-40a5-98bc-3b022dd98009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.293324 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5d37b-30b3-40a5-98bc-3b022dd98009 admin admin] PATH_INFO: `/v3/projects/ba97ba34efee4cd0a752cae736f2da8d/users/b886a6ece65346e09953446fd0020e96/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.314832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '800d840acd214552add9b35a6cbd765d', 'request_id': 'req-1394747a-fda6-40bc-8fbc-9dae17a05bbb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:23.326820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5d37b-30b3-40a5-98bc-3b022dd98009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba97ba34efee4cd0a752cae736f2da8d, user_id=b886a6ece65346e09953446fd0020e96, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.329829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5d37b-30b3-40a5-98bc-3b022dd98009 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.333057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '800d840acd214552add9b35a6cbd765d', 'request_id': 'req-1394747a-fda6-40bc-8fbc-9dae17a05bbb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:23.345922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '800d840acd214552add9b35a6cbd765d', 'request_id': 'req-1394747a-fda6-40bc-8fbc-9dae17a05bbb'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:23.349883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1167/2361] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:23 2022] PUT /identity/v3/projects/ba97ba34efee4cd0a752cae736f2da8d/users/b886a6ece65346e09953446fd0020e96/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:23.361678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.362126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.362502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.364244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] The token cache is being invalidate because project 800d840acd214552add9b35a6cbd765d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:23.364651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:23.365365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1394747a-fda6-40bc-8fbc-9dae17a05bbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:23.366947 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1195/2362] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:23 2022] DELETE /identity/v3/projects/800d840acd214552add9b35a6cbd765d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:23.371836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f4cd9-0175-4dc4-bbbb-cf59af2bfae5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.372232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f4cd9-0175-4dc4-bbbb-cf59af2bfae5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.372606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f4cd9-0175-4dc4-bbbb-cf59af2bfae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.395137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-795f4cd9-0175-4dc4-bbbb-cf59af2bfae5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:23.396315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-795f4cd9-0175-4dc4-bbbb-cf59af2bfae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:23.399514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] MFA Rules not processed for user `b886a6ece65346e09953446fd0020e96`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:23.401722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:23.470619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1196/2363] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:23.480341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54682-994c-41d1-aeb5-6eabacb6cc5f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.480697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54682-994c-41d1-aeb5-6eabacb6cc5f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.480978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54682-994c-41d1-aeb5-6eabacb6cc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.508309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-eac54682-994c-41d1-aeb5-6eabacb6cc5f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:23.509673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-eac54682-994c-41d1-aeb5-6eabacb6cc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:23.521755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1197/2364] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:23.528187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54682-994c-41d1-aeb5-6eabacb6cc5f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.538788 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54682-994c-41d1-aeb5-6eabacb6cc5f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.544831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.545586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.545968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.546440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.547245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:23.547557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.549204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.567197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1198/2365] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:23.574237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.579485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1168/2366] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:23.583486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.585272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:23.589234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6dd11-e111-4a0c-8238-e1f0407c64cf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.595517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.596200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.596484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.596778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.597399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.600457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.625814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a2b56-71a7-421c-952e-198b296891e9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.635650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.636766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.637051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.637349 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.640783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.641555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.649895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1199/2367] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:23 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:23.655119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.697327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1169/2368] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:23 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:23.698946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:23.699407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.761592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f63be-e85f-4368-87eb-0b3c1a777aaa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.789989 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e5738-086f-45cd-90d7-42d3c6f894f7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.796987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.797925 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.798204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.798473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.799116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.801096 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.815199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:23.832073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1170/2369] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:23 2022] POST /identity/v3/users => generated 297 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:23.835168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.840044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.840732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.841048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.841373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.842220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.845270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.847342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d36c7-caf4-4c52-87c0-45e5c708ecc3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.852053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.852726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.853063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.853402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.855077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.857821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.870482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1171/2370] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:23.871487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1200/2371] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:23 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:23.877656 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.877971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.888414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d578cf-a0c6-4b79-9d94-40819d114ce2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.889241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99533b-af96-48ad-8527-ebad8a01cf69 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.893982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.894358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.894698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.894974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.895155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.895284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] PATH_INFO: `/v3/projects/16a29f8465f74a28bce448079d946f30/users/ddc4cbab6b4f4cfe9013d8dd75208dcb/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.895551 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.895990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.896698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.899486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.912091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1201/2372] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:23.915717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.915982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a29f8465f74a28bce448079d946f30, user_id=ddc4cbab6b4f4cfe9013d8dd75208dcb, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.919703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.928134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed4216-da74-4203-aee9-81d3ada13a03 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:23.933973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:23.934612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:23.934892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:23.935167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:23.935823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:23.937544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:23.938495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1172/2373] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:23 2022] PUT /identity/v3/projects/16a29f8465f74a28bce448079d946f30/users/ddc4cbab6b4f4cfe9013d8dd75208dcb/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:23.942735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.952063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1202/2374] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:23.956058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:23.968247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e4491-577a-4e5f-8671-039f8a1dd7c5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.029736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706046b8-fa13-4a89-9e46-d16303cb1692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.030502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706046b8-fa13-4a89-9e46-d16303cb1692 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.030855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706046b8-fa13-4a89-9e46-d16303cb1692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.031239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706046b8-fa13-4a89-9e46-d16303cb1692 admin admin] PATH_INFO: `/v3/projects/aa431573de9e44539b0afa8aced4aca9/users/7526d915a30f4005a3ac57753989a734/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.044466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707c5c5-269e-4760-aed7-cae1f5c8f7eb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.049342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.049922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.050202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.050477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.051131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.052686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706046b8-fa13-4a89-9e46-d16303cb1692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa431573de9e44539b0afa8aced4aca9, user_id=7526d915a30f4005a3ac57753989a734, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.052811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.055724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706046b8-fa13-4a89-9e46-d16303cb1692 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.065363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1173/2375] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:24.070000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.076436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1203/2376] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:23 2022] PUT /identity/v3/projects/aa431573de9e44539b0afa8aced4aca9/users/7526d915a30f4005a3ac57753989a734/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:24.089455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb696-8e4e-4e1e-a8c9-f727bd5d1392 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.089455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb696-8e4e-4e1e-a8c9-f727bd5d1392 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.089685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bb696-8e4e-4e1e-a8c9-f727bd5d1392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.090362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e00524-b5fb-4760-9e91-4921e1e52e9e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.126542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9f1bb696-8e4e-4e1e-a8c9-f727bd5d1392 None None] MFA Rules not processed for user `7526d915a30f4005a3ac57753989a734`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:24.127881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9f1bb696-8e4e-4e1e-a8c9-f727bd5d1392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:24.134513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:24.164461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563846e-e9d3-449f-a83d-604721f6f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.165139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563846e-e9d3-449f-a83d-604721f6f6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.165556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563846e-e9d3-449f-a83d-604721f6f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.165706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563846e-e9d3-449f-a83d-604721f6f6f5 admin admin] PATH_INFO: `/v3/projects/16a29f8465f74a28bce448079d946f30/users/ddc4cbab6b4f4cfe9013d8dd75208dcb/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.171937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563846e-e9d3-449f-a83d-604721f6f6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a29f8465f74a28bce448079d946f30, user_id=ddc4cbab6b4f4cfe9013d8dd75208dcb, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.175320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563846e-e9d3-449f-a83d-604721f6f6f5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.204276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1174/2377] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:24 2022] PUT /identity/v3/projects/16a29f8465f74a28bce448079d946f30/users/ddc4cbab6b4f4cfe9013d8dd75208dcb/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:24.205836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eed02-8032-447b-a158-2e72f076be67 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.206133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eed02-8032-447b-a158-2e72f076be67 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.206496 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70eed02-8032-447b-a158-2e72f076be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.230437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1204/2378] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:24.233146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a70eed02-8032-447b-a158-2e72f076be67 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:24.234855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a70eed02-8032-447b-a158-2e72f076be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:24.236247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.236806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.237292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.284263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] MFA Rules not processed for user `ddc4cbab6b4f4cfe9013d8dd75208dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:24.285667 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:24.317827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:24.335231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1175/2379] 10.222.0.50 () {58 vars in 967 bytes} [Wed Sep 14 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:24.336267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eed02-8032-447b-a158-2e72f076be67 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.400339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1205/2380] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:24.401422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.406844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:24.437361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70eed02-8032-447b-a158-2e72f076be67 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.443543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.444275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.444624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.445101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.445730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.456225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.509617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1176/2381] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:24 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:24.511611 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.515329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:24.520134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd3137-0461-483e-ac94-42cf7be6677d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.580902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:24.612693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b938a7-6f34-4843-9302-30b31605a376 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.616811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.617666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.618022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.618364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.647570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.648366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.648651 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.648923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.705747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.707316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.719851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1177/2382] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:24.720842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.740957 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.742993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.752264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1206/2383] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:07:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:07:24.761542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.762948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:24.802232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:24.865378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf61f08-b89e-4d35-8472-ae3e21be7764 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.873190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.873742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.874124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.874277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.874918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.876879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.896876 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a563dd-af10-43b4-8fd0-4b057ebd6322 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.903077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.903713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.904128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.904305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.906781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:24.913498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1178/2384] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:24 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:24.913498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.923759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ce6ec-667f-4407-b7a3-f34a7768f0ca admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.927430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.928477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.929039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:24.929166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.929359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.929640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.942586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1207/2385] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:24.943267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:24.956053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3d567-987f-4108-9c3e-e328fe8edd46 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:24.962439 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:24.962983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:24.963683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:24.964487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:24.965146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:24.973478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:25.001316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1208/2386] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:25.002862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:25.020924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3630f6-763f-43de-ae80-8d6482b83644 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:25.026994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:25.028211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:25.030870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:25.031958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:25.032294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:25.032812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] PATH_INFO: `/v3/projects/e7037418a4144d1f804df50c7d567a57/users/c28a0a487e214edd88661ae837282c57/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:25.040722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1179/2387] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:25.055474 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7037418a4144d1f804df50c7d567a57, user_id=c28a0a487e214edd88661ae837282c57, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:25.059121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:25.088144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1209/2388] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:25 2022] PUT /identity/v3/projects/e7037418a4144d1f804df50c7d567a57/users/c28a0a487e214edd88661ae837282c57/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:25.089480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:25.104999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79623a0-7e46-4f38-a6e1-84f5651305f1 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:25.218018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4d876-c4b1-4bf3-ae99-c979a7d24d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:25.218657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d876-c4b1-4bf3-ae99-c979a7d24d16 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:25.219119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d876-c4b1-4bf3-ae99-c979a7d24d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:25.219494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d876-c4b1-4bf3-ae99-c979a7d24d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:25.221154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4d876-c4b1-4bf3-ae99-c979a7d24d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:25.223020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4d876-c4b1-4bf3-ae99-c979a7d24d16 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:25.242121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:25.248113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1180/2389] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:25.271652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead9fa5-d6d8-4e42-bb6a-ecdd90b681f6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:25.279673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:25.281117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:25.281402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:25.281674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] PATH_INFO: `/v3/projects/e7037418a4144d1f804df50c7d567a57/users/c28a0a487e214edd88661ae837282c57/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:25.284290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7037418a4144d1f804df50c7d567a57, user_id=c28a0a487e214edd88661ae837282c57, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:25.287165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:25.315802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1210/2390] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:25 2022] PUT /identity/v3/projects/e7037418a4144d1f804df50c7d567a57/users/c28a0a487e214edd88661ae837282c57/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:25.317883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d19da-205d-4d35-8517-179407fb87dc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:25.318278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d19da-205d-4d35-8517-179407fb87dc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:25.318571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d19da-205d-4d35-8517-179407fb87dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:25.350414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-507d19da-205d-4d35-8517-179407fb87dc None None] MFA Rules not processed for user `c28a0a487e214edd88661ae837282c57`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:25.351758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-507d19da-205d-4d35-8517-179407fb87dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:25.405644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:25.455722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1181/2391] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:25.468873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:25.514710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:25.563686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead33b7d-aa79-4c96-a326-0c543b05a23c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:25.574886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81d135-be46-423e-81c0-dae29b2a1209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:25.575768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d135-be46-423e-81c0-dae29b2a1209 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:25.575768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d135-be46-423e-81c0-dae29b2a1209 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:25.576097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81d135-be46-423e-81c0-dae29b2a1209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:25.591333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81d135-be46-423e-81c0-dae29b2a1209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:25.593064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81d135-be46-423e-81c0-dae29b2a1209 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:25.606306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1211/2392] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:26.346616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d19da-205d-4d35-8517-179407fb87dc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:26.462618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d19da-205d-4d35-8517-179407fb87dc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:26.472322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:26.473450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:26.474357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:26.474357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] PATH_INFO: `/v3/users/7526d915a30f4005a3ac57753989a734` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:26.476182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7526d915a30f4005a3ac57753989a734)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:26.478163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:26.557889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7526d915a30f4005a3ac57753989a734'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:26.558748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7526d915a30f4005a3ac57753989a734'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:26.559495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7526d915a30f4005a3ac57753989a734'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:26.568518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7526d915a30f4005a3ac57753989a734'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:26.586701 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7526d915a30f4005a3ac57753989a734'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:26.608779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1182/2393] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:26 2022] DELETE /identity/v3/users/7526d915a30f4005a3ac57753989a734 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:26.613684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:26.614131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:26.615270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:26.641969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:26.643254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:26.814723 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1212/2394] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:26.821892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:26.824126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:26.931365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1841-aed8-4f2a-a89e-ca9f598841d4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:26.936571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:26.945336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:26.945807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:26.946269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:26.963752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:26.963752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:26.972156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1183/2395] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:27.463672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:27.466064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:27.479306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a79ce6-d6d0-4838-a0d0-87ba5ae4e5f0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:27.484475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:27.485133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:27.485412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:27.485688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] PATH_INFO: `/v3/projects/aa431573de9e44539b0afa8aced4aca9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:27.487294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa431573de9e44539b0afa8aced4aca9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:27.488976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:27.551927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa431573de9e44539b0afa8aced4aca9', 'request_id': 'req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.562354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa431573de9e44539b0afa8aced4aca9', 'request_id': 'req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.573423 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa431573de9e44539b0afa8aced4aca9', 'request_id': 'req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.588822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] The token cache is being invalidate because project aa431573de9e44539b0afa8aced4aca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:27.589101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.589789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.591335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1213/2396] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:27 2022] DELETE /identity/v3/projects/aa431573de9e44539b0afa8aced4aca9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:27.595549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:27.600642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:27.608231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508f3c7-3128-42d5-8f2d-172be5062383 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:27.693875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:27.694520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:27.694802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:27.695079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] PATH_INFO: `/v3/users/c28a0a487e214edd88661ae837282c57` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:27.696337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28a0a487e214edd88661ae837282c57)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:27.698606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:27.756568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28a0a487e214edd88661ae837282c57'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.757248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28a0a487e214edd88661ae837282c57'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.757963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28a0a487e214edd88661ae837282c57'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.766319 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28a0a487e214edd88661ae837282c57'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.783057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1369c476-9f76-4a0f-a858-5ffbb73e8905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28a0a487e214edd88661ae837282c57'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:27.811681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1184/2397] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:27 2022] DELETE /identity/v3/users/c28a0a487e214edd88661ae837282c57 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:28.219533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:28.223558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:28.254865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1b454-0ed0-46fd-9a13-aa318a0ef143 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:28.354852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:28.364517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:28.365574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.366402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.366402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] PATH_INFO: `/v3/projects/e7037418a4144d1f804df50c7d567a57` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.368883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7037418a4144d1f804df50c7d567a57)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:28.370964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:28.422525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7037418a4144d1f804df50c7d567a57', 'request_id': 'req-3988e585-f0e0-4e87-8df9-8587cc100425'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:28.429332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7037418a4144d1f804df50c7d567a57', 'request_id': 'req-3988e585-f0e0-4e87-8df9-8587cc100425'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:28.438966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7037418a4144d1f804df50c7d567a57', 'request_id': 'req-3988e585-f0e0-4e87-8df9-8587cc100425'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:28.452357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] The token cache is being invalidate because project e7037418a4144d1f804df50c7d567a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:28.452851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:28.453894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3988e585-f0e0-4e87-8df9-8587cc100425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:28.460105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1214/2398] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:28 2022] DELETE /identity/v3/projects/e7037418a4144d1f804df50c7d567a57 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:28.462018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdd3be-6c28-478a-9bec-de4ad0618438 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.462308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdd3be-6c28-478a-9bec-de4ad0618438 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.462580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdd3be-6c28-478a-9bec-de4ad0618438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.485360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-81bdd3be-6c28-478a-9bec-de4ad0618438 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:28.486774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-81bdd3be-6c28-478a-9bec-de4ad0618438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:28.553816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1185/2399] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:28.564085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251c04-3ef0-4120-a270-46f8b161eab4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.564550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251c04-3ef0-4120-a270-46f8b161eab4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.565209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251c04-3ef0-4120-a270-46f8b161eab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.586522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-87251c04-3ef0-4120-a270-46f8b161eab4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:28.587890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-87251c04-3ef0-4120-a270-46f8b161eab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:28.596950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1215/2400] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:28.601432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdd3be-6c28-478a-9bec-de4ad0618438 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:28.611752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdd3be-6c28-478a-9bec-de4ad0618438 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:28.617119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:28.617856 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.618011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.618294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.618979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:28.619330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:28.621122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:28.633571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1186/2401] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:28.639149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251c04-3ef0-4120-a270-46f8b161eab4 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:28.648958 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251c04-3ef0-4120-a270-46f8b161eab4 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:28.654826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:28.655433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.655761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.656062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.656695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:28.658979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:28.689019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1216/2402] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:28 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:28.694600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:28.705631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded4505-8811-4f72-8891-a3854eb9b3aa admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:28.710761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:28.766395 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:28.767001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.767282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.767555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.768257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:28.770235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:28.792498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1187/2403] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:28 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:28.796654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:28.807232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73cfb5-f5be-42a8-bc1f-392a16efb676 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:28.816281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:28.817194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.817473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.817745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.818430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:28.820154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:28.831424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1217/2404] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:28.835639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:28.846873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06303bab-2464-4de8-ba05-3a5e2d4e6992 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:28.851604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c95ad-0c8b-4d2b-a58e-bb82c9c3ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:28.852271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c95ad-0c8b-4d2b-a58e-bb82c9c3ad8c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.852549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c95ad-0c8b-4d2b-a58e-bb82c9c3ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.852824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c95ad-0c8b-4d2b-a58e-bb82c9c3ad8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.853466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c95ad-0c8b-4d2b-a58e-bb82c9c3ad8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:28.856119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c95ad-0c8b-4d2b-a58e-bb82c9c3ad8c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:28.868585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1188/2405] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:28.873721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:28.883776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fa489-aa56-4d76-91a7-b9b5ea8fab78 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:28.888924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:28.889586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.889866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.890137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] PATH_INFO: `/v3/projects/4b19865ebafb4188bb17506d67063b43/users/4d4f9b906f674c77b984345bedf99f9b/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.906590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b19865ebafb4188bb17506d67063b43, user_id=4d4f9b906f674c77b984345bedf99f9b, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:28.909886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:28.924316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1218/2406] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:28 2022] PUT /identity/v3/projects/4b19865ebafb4188bb17506d67063b43/users/4d4f9b906f674c77b984345bedf99f9b/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:28.934597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4574189-4166-441c-92f4-3b6563e1b138 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:28.934889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4574189-4166-441c-92f4-3b6563e1b138 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:28.935168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4574189-4166-441c-92f4-3b6563e1b138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:28.968771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f4574189-4166-441c-92f4-3b6563e1b138 None None] MFA Rules not processed for user `4d4f9b906f674c77b984345bedf99f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:28.970352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f4574189-4166-441c-92f4-3b6563e1b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:29.055705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1189/2407] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:29.061132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:29.125400 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5eb853-e549-4892-acb1-c8d45cf701d1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:29.131278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:29.131984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.132298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.132568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.133369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:29.136246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:29.165968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1219/2408] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:29 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:29.170757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4574189-4166-441c-92f4-3b6563e1b138 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:29.181632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4574189-4166-441c-92f4-3b6563e1b138 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:29.247229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:29.247848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.248172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.248448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.249101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:29.251116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:29.275200 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1190/2409] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:29 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:29.279973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:29.295884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd731f2-cca0-463f-8646-6dfb3096c6e8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:29.303168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:29.303777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.304142 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.304546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.305227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:29.308468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:29.310028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:29.324758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1220/2410] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:29.325948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:29.337465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc059b2-98d8-417b-a3fa-92e2db286e89 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:29.344103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:29.344851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.345188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.345550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] PATH_INFO: `/v3/projects/be0aeadcda32400a827e2b30d1b4d048/users/9ab7607746594e4eba885e9ffcfd8477/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.348090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:29.365951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0aeadcda32400a827e2b30d1b4d048, user_id=9ab7607746594e4eba885e9ffcfd8477, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:29.373966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:29.386775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1191/2411] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:29 2022] PUT /identity/v3/projects/be0aeadcda32400a827e2b30d1b4d048/users/9ab7607746594e4eba885e9ffcfd8477/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:29.390934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:29.402470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094a46-4f30-4bb1-9378-86fcb747ba9e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:29.502073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d19f4b-5d9a-401a-a4aa-8bbb0f113b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:29.502693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19f4b-5d9a-401a-a4aa-8bbb0f113b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.502979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19f4b-5d9a-401a-a4aa-8bbb0f113b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.503250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d19f4b-5d9a-401a-a4aa-8bbb0f113b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.503917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19f4b-5d9a-401a-a4aa-8bbb0f113b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:29.505717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d19f4b-5d9a-401a-a4aa-8bbb0f113b4b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:29.518855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1221/2412] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:29.523572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:29.535909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4189e-a539-4526-80ce-7115f580f4de admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:29.540934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:29.541622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.541905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.542185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] PATH_INFO: `/v3/projects/be0aeadcda32400a827e2b30d1b4d048/users/9ab7607746594e4eba885e9ffcfd8477/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.544238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0aeadcda32400a827e2b30d1b4d048, user_id=9ab7607746594e4eba885e9ffcfd8477, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:29.548268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:29.561345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1192/2413] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:29 2022] PUT /identity/v3/projects/be0aeadcda32400a827e2b30d1b4d048/users/9ab7607746594e4eba885e9ffcfd8477/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:29.571507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e313-5e51-4226-8954-bc0af40a5745 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.571996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e313-5e51-4226-8954-bc0af40a5745 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.573218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18e313-5e51-4226-8954-bc0af40a5745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.603532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-2a18e313-5e51-4226-8954-bc0af40a5745 None None] MFA Rules not processed for user `9ab7607746594e4eba885e9ffcfd8477`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:29.604821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2a18e313-5e51-4226-8954-bc0af40a5745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:29.685054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1222/2414] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:29.697269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:29.700251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:29.768346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a8417-ead7-4cbf-ad51-7db5763dd787 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:29.772249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf1fcc-ab92-434e-a6bb-f5d0a6027791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:29.773045 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1fcc-ab92-434e-a6bb-f5d0a6027791 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:29.773330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1fcc-ab92-434e-a6bb-f5d0a6027791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:29.773598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1fcc-ab92-434e-a6bb-f5d0a6027791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:29.784495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf1fcc-ab92-434e-a6bb-f5d0a6027791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:29.785911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf1fcc-ab92-434e-a6bb-f5d0a6027791 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:29.797264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1193/2415] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:30.212335 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e313-5e51-4226-8954-bc0af40a5745 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:30.281758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18e313-5e51-4226-8954-bc0af40a5745 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:30.286352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:30.286977 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:30.287254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:30.287523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] PATH_INFO: `/v3/users/4d4f9b906f674c77b984345bedf99f9b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:30.288655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4f9b906f674c77b984345bedf99f9b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:30.290563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:30.313753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:30.342440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4f9b906f674c77b984345bedf99f9b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:30.343029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4f9b906f674c77b984345bedf99f9b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:30.343652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4f9b906f674c77b984345bedf99f9b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:30.350919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4f9b906f674c77b984345bedf99f9b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:30.363034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4f9b906f674c77b984345bedf99f9b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:30.376422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1223/2416] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:30 2022] DELETE /identity/v3/users/4d4f9b906f674c77b984345bedf99f9b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:30.380958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:30.381248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:30.381525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:30.413833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:30.415143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:30.474962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1194/2417] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:30.484851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:30.486253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:30.547483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0d36-2a42-4695-8a07-fbacdb54de90 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:30.551212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:30.551818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:30.552127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:30.552401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:30.562940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:30.564354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:30.575052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1224/2418] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:30.683511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:30.685278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:30.705685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d3ea-684c-423e-8def-6f21ce70d5a9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:30.711678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:30.712767 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:30.713941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:30.714446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:30.717359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:30.738581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:30.741375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:30.756455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1195/2419] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:30.909228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:30.910760 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:30.925225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd773b50-35be-4dc0-a3cf-52af74a483b0 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:30.933340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:30.933340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:30.933672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:30.933771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] PATH_INFO: `/v3/projects/4b19865ebafb4188bb17506d67063b43` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:30.935130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b19865ebafb4188bb17506d67063b43)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:30.944006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:30.997368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b19865ebafb4188bb17506d67063b43', 'request_id': 'req-38b29101-7a20-400e-9015-d65ed7899f51'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.007300 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b19865ebafb4188bb17506d67063b43', 'request_id': 'req-38b29101-7a20-400e-9015-d65ed7899f51'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.018299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b19865ebafb4188bb17506d67063b43', 'request_id': 'req-38b29101-7a20-400e-9015-d65ed7899f51'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.041188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] The token cache is being invalidate because project 4b19865ebafb4188bb17506d67063b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:31.041753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.044173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.052102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1225/2420] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:30 2022] DELETE /identity/v3/projects/4b19865ebafb4188bb17506d67063b43 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:31.053739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:31.066729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056c105-c378-4e45-97d5-efff210554d1 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:31.153792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:31.155741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:31.156372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:31.156659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] PATH_INFO: `/v3/users/9ab7607746594e4eba885e9ffcfd8477` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:31.158077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab7607746594e4eba885e9ffcfd8477)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:31.160366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:31.162605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:31.241671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab7607746594e4eba885e9ffcfd8477'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.242532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab7607746594e4eba885e9ffcfd8477'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.243550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab7607746594e4eba885e9ffcfd8477'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.266732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab7607746594e4eba885e9ffcfd8477'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.314693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0d626105-bfb4-41e3-a86a-3ed205589a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab7607746594e4eba885e9ffcfd8477'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:31.335269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1196/2421] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:31 2022] DELETE /identity/v3/users/9ab7607746594e4eba885e9ffcfd8477 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:31.848939 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:31.850766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:31.866642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b29101-7a20-400e-9015-d65ed7899f51 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:31.890251 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:31.934680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:31.935263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:31.935550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:31.935918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] PATH_INFO: `/v3/projects/be0aeadcda32400a827e2b30d1b4d048` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:31.937629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0aeadcda32400a827e2b30d1b4d048)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:31.939549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.000983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0aeadcda32400a827e2b30d1b4d048', 'request_id': 'req-2a242037-8489-4bd1-914c-881e270821df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.008271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0aeadcda32400a827e2b30d1b4d048', 'request_id': 'req-2a242037-8489-4bd1-914c-881e270821df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.019399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0aeadcda32400a827e2b30d1b4d048', 'request_id': 'req-2a242037-8489-4bd1-914c-881e270821df'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.035154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] The token cache is being invalidate because project be0aeadcda32400a827e2b30d1b4d048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:32.035446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.036318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2a242037-8489-4bd1-914c-881e270821df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.038352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1226/2422] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:31 2022] DELETE /identity/v3/projects/be0aeadcda32400a827e2b30d1b4d048 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:32.044217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea34469-234d-43b2-bf7c-fa065a83310e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.044810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea34469-234d-43b2-bf7c-fa065a83310e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.044810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea34469-234d-43b2-bf7c-fa065a83310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.066770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4ea34469-234d-43b2-bf7c-fa065a83310e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:32.068033 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4ea34469-234d-43b2-bf7c-fa065a83310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:32.141761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1197/2423] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:32.152077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3069c3-d611-4139-832f-0ff694de1254 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.152361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3069c3-d611-4139-832f-0ff694de1254 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.152649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3069c3-d611-4139-832f-0ff694de1254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.179212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4d3069c3-d611-4139-832f-0ff694de1254 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:32.180847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4d3069c3-d611-4139-832f-0ff694de1254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:32.190060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1227/2424] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:32.194507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea34469-234d-43b2-bf7c-fa065a83310e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.205251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea34469-234d-43b2-bf7c-fa065a83310e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.209919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.210522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.210801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.211482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.211715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:32.212037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.214327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.226481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1198/2425] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:32.231811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3069c3-d611-4139-832f-0ff694de1254 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.242268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3069c3-d611-4139-832f-0ff694de1254 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.248288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.248909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.249186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.249464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.250138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.252068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.288581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1228/2426] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:32 2022] POST /identity/v3/projects => generated 359 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:32.293822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.304432 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a11ec2-3365-44ad-885f-194d9f4cf86a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.365717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.366330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.366612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.366886 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.368000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.370305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.382186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:32.395437 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1199/2427] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:32 2022] POST /identity/v3/users => generated 280 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:32.399288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.411457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55b0bd-3fd5-4f95-8ee8-bdf0f0239f4d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.417914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.419122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.419341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.419720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.420724 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.422355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.437361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1229/2428] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:32.440212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.453315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa3553-e44a-4771-8344-b96f270df247 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.461923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3afdb-b9ed-4d51-8624-cc482ab91658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.463034 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3afdb-b9ed-4d51-8624-cc482ab91658 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.464060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3afdb-b9ed-4d51-8624-cc482ab91658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.464681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3afdb-b9ed-4d51-8624-cc482ab91658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.465689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3afdb-b9ed-4d51-8624-cc482ab91658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.467290 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b3afdb-b9ed-4d51-8624-cc482ab91658 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.482549 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1200/2429] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:32.483744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.494858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984c1c9-0c72-4647-ad7a-dc6efaa52ee1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.501604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.502387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.502769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.503147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] PATH_INFO: `/v3/projects/6351fdc989e84e9e9a05fe0074e275ad/users/90fbe75c78e74bc1a04273ac3fcf0bb9/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.524275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6351fdc989e84e9e9a05fe0074e275ad, user_id=90fbe75c78e74bc1a04273ac3fcf0bb9, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.527290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.547165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1230/2430] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:32 2022] PUT /identity/v3/projects/6351fdc989e84e9e9a05fe0074e275ad/users/90fbe75c78e74bc1a04273ac3fcf0bb9/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:32.560649 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.560949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.561225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.621212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.623164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:32.625025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] MFA Rules not processed for user `90fbe75c78e74bc1a04273ac3fcf0bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:32.626250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:32.748646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:32.781573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72315ef5-0939-47a7-b64b-72ce0bf7b388 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.784629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1201/2431] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:32.787619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.788546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.789030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.789483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] PATH_INFO: `/v3/users/b886a6ece65346e09953446fd0020e96` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.791689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b886a6ece65346e09953446fd0020e96)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.794592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.826495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.828962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:32.882419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b886a6ece65346e09953446fd0020e96'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.883122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b886a6ece65346e09953446fd0020e96'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.883738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b886a6ece65346e09953446fd0020e96'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.895333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b886a6ece65346e09953446fd0020e96'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.912418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ceb382c7-39b5-4b0a-93aa-d3ffabe46987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b886a6ece65346e09953446fd0020e96'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:32.926798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473fca4-bfa0-4811-a18d-d41ff5840453 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:32.931305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:32.931652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.932736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.933002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.934905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:32.935928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1231/2432] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:32 2022] DELETE /identity/v3/users/b886a6ece65346e09953446fd0020e96 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:32.940854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:32.941466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:32.941935 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:32.948642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:32.950393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:32.968771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1202/2433] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:32.973805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:32.975248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:32.987446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:32.989105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:33.007943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d5a53-038c-40c8-9c64-a9078c6fbc44 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:33.104368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1232/2434] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:33.114983 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:33.115460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:33.116217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:33.116771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:33.117123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] PATH_INFO: `/v3/users/90fbe75c78e74bc1a04273ac3fcf0bb9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:33.117799 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:33.120789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fbe75c78e74bc1a04273ac3fcf0bb9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:33.123480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:33.175098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:33.205363 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9dc933-f02f-4140-8e60-a9394901ea6a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:33.210925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2020c2-0b39-4150-a18d-cf7bddd486c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:33.211956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2020c2-0b39-4150-a18d-cf7bddd486c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:33.212274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2020c2-0b39-4150-a18d-cf7bddd486c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:33.212545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2020c2-0b39-4150-a18d-cf7bddd486c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:33.226041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fbe75c78e74bc1a04273ac3fcf0bb9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.226834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fbe75c78e74bc1a04273ac3fcf0bb9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.227543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fbe75c78e74bc1a04273ac3fcf0bb9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.232199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2020c2-0b39-4150-a18d-cf7bddd486c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:33.233674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2020c2-0b39-4150-a18d-cf7bddd486c6 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:33.246166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fbe75c78e74bc1a04273ac3fcf0bb9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.247440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1233/2435] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:33.277224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fbe75c78e74bc1a04273ac3fcf0bb9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.301556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1203/2436] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:32 2022] DELETE /identity/v3/users/90fbe75c78e74bc1a04273ac3fcf0bb9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:33.307465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:33.308001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:33.308486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:33.355001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:33.356269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:33.375266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:33.483022 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1234/2437] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:33.509316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:33.511555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:33.588100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929cc68-0138-4141-8d44-a55e19fac189 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:33.598210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:33.599664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:33.600212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:33.600702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:33.629699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:33.634543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:33.663325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1204/2438] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:33.784844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:33.789127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:33.804694 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a59a48-d3f3-4967-a7dc-e24080a13cc0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:33.811672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:33.812996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:33.813582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:33.814390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] PATH_INFO: `/v3/projects/ba97ba34efee4cd0a752cae736f2da8d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:33.816214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba97ba34efee4cd0a752cae736f2da8d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:33.820619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:33.895096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba97ba34efee4cd0a752cae736f2da8d', 'request_id': 'req-9a79c10e-f829-485e-89e9-3beec2e1608c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.912648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba97ba34efee4cd0a752cae736f2da8d', 'request_id': 'req-9a79c10e-f829-485e-89e9-3beec2e1608c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.923485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba97ba34efee4cd0a752cae736f2da8d', 'request_id': 'req-9a79c10e-f829-485e-89e9-3beec2e1608c'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.944259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] The token cache is being invalidate because project ba97ba34efee4cd0a752cae736f2da8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:33.944691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.946696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:33.952522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1235/2439] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:33 2022] DELETE /identity/v3/projects/ba97ba34efee4cd0a752cae736f2da8d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:33.956268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:33.993424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7c45b-1370-4dad-ad0f-cc4b42a17198 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:34.103681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:34.104828 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.106228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.106593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] PATH_INFO: `/v3/users/ddc4cbab6b4f4cfe9013d8dd75208dcb` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.108143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc4cbab6b4f4cfe9013d8dd75208dcb)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:34.110963 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:34.174543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:34.183262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc4cbab6b4f4cfe9013d8dd75208dcb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.184588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc4cbab6b4f4cfe9013d8dd75208dcb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.186652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc4cbab6b4f4cfe9013d8dd75208dcb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.200155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc4cbab6b4f4cfe9013d8dd75208dcb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.215211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:34.216806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:34.229069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f11ccd35-a680-499d-b51a-3c2097fd5c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc4cbab6b4f4cfe9013d8dd75208dcb'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.239746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79c10e-f829-485e-89e9-3beec2e1608c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:34.246932 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:34.247579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.247918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.248233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] PATH_INFO: `/v3/projects/6351fdc989e84e9e9a05fe0074e275ad` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.250094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6351fdc989e84e9e9a05fe0074e275ad)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:34.252890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:34.264329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1205/2440] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:33 2022] DELETE /identity/v3/users/ddc4cbab6b4f4cfe9013d8dd75208dcb => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:34.348430 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6351fdc989e84e9e9a05fe0074e275ad', 'request_id': 'req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.362631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6351fdc989e84e9e9a05fe0074e275ad', 'request_id': 'req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.373679 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6351fdc989e84e9e9a05fe0074e275ad', 'request_id': 'req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.390999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] The token cache is being invalidate because project 6351fdc989e84e9e9a05fe0074e275ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:34.391748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.393182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c1f3eac4-d5ce-4ce6-96f5-a5b38735dbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.395793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1236/2441] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:34 2022] DELETE /identity/v3/projects/6351fdc989e84e9e9a05fe0074e275ad => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:34.402677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104688d-7ba1-4546-8584-8ac8e54e83c2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.403456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104688d-7ba1-4546-8584-8ac8e54e83c2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.403922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104688d-7ba1-4546-8584-8ac8e54e83c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.435400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b104688d-7ba1-4546-8584-8ac8e54e83c2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:34.436833 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b104688d-7ba1-4546-8584-8ac8e54e83c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:34.529544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1206/2442] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:34.539040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70714-9376-4bf0-b359-68317f221a41 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.539346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70714-9376-4bf0-b359-68317f221a41 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.539761 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff70714-9376-4bf0-b359-68317f221a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.564606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8ff70714-9376-4bf0-b359-68317f221a41 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:34.565993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8ff70714-9376-4bf0-b359-68317f221a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:34.577806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1237/2443] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:34.582623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104688d-7ba1-4546-8584-8ac8e54e83c2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:34.593455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104688d-7ba1-4546-8584-8ac8e54e83c2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:34.599155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:34.599798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.600116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.601117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.601793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:34.602785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:34.605519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:34.635571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1207/2444] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:34.640461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff70714-9376-4bf0-b359-68317f221a41 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:34.652160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff70714-9376-4bf0-b359-68317f221a41 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:34.655311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:34.658208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:34.658918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:34.659766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.660261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.660715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.661717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:34.664181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:34.677889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731bcf9-e769-41ae-9e39-3cea6b8f7f67 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:34.683974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:34.685445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:34.686790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.687167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.687529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] PATH_INFO: `/v3/projects/16a29f8465f74a28bce448079d946f30` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.688700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a29f8465f74a28bce448079d946f30)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:34.690607 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:34.717581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1238/2445] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:34 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:34.721695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:34.749753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a29f8465f74a28bce448079d946f30', 'request_id': 'req-687b541c-5c55-4274-b4bb-023a7d83f093'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.756996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a29f8465f74a28bce448079d946f30', 'request_id': 'req-687b541c-5c55-4274-b4bb-023a7d83f093'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.766327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a29f8465f74a28bce448079d946f30', 'request_id': 'req-687b541c-5c55-4274-b4bb-023a7d83f093'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.782816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] The token cache is being invalidate because project 16a29f8465f74a28bce448079d946f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:34.783117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.783778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-687b541c-5c55-4274-b4bb-023a7d83f093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:34.785351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1208/2446] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:34 2022] DELETE /identity/v3/projects/16a29f8465f74a28bce448079d946f30 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:34.790543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaae94d-df2b-4f75-9ddc-cdf92227e9b0 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.790791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaae94d-df2b-4f75-9ddc-cdf92227e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.792224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaae94d-df2b-4f75-9ddc-cdf92227e9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.807471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cee6c5-6629-4570-9bc5-caafa38cb59a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:34.823104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fcaae94d-df2b-4f75-9ddc-cdf92227e9b0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:34.824769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fcaae94d-df2b-4f75-9ddc-cdf92227e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:34.893228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:34.893228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.893228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.893228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.893701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:34.895319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:34.913675 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:34.926507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1239/2447] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:34 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:34.930863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:34.933613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:34.957964 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1209/2448] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:34.963482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddeb32-88cb-4033-b063-92e0ecfa20ea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:34.967382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd10d4-8929-4087-ad36-48f9646a4e8d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.967671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd10d4-8929-4087-ad36-48f9646a4e8d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.967973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd10d4-8929-4087-ad36-48f9646a4e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.983863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:34.984639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:34.984916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:34.985185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:34.985843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:34.987441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.004715 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1240/2449] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:35.005435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d7fd10d4-8929-4087-ad36-48f9646a4e8d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:35.006114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.007124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d7fd10d4-8929-4087-ad36-48f9646a4e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:35.020200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349080b3-1380-41fe-82cb-89c4750691e8 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.020591 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1210/2450] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:35.023900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd10d4-8929-4087-ad36-48f9646a4e8d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.030492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.031672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.031953 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.032308 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.033231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.034835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.034979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd10d4-8929-4087-ad36-48f9646a4e8d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.039624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.040258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.040612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.041042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.041739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:35.042565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.044216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.048344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1241/2451] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:35.052756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.058190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1211/2452] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:07:35.063071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.065315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc778ac-daeb-41fd-8fc8-6470ad33f870 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.074739 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.075418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.075699 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.075969 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] PATH_INFO: `/v3/projects/99598543ff8c4c7eb27fe91734eb9eb3/users/85c6eafaf80543ff8ac6f349c1ea9dab/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.076851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522b5a-f667-4541-81e7-c3592cf55163 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.091409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e025f5-fbd2-43be-9cc2-764039779ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.092156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e025f5-fbd2-43be-9cc2-764039779ede admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.092584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e025f5-fbd2-43be-9cc2-764039779ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.092837 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e025f5-fbd2-43be-9cc2-764039779ede admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.093563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e025f5-fbd2-43be-9cc2-764039779ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.094762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=99598543ff8c4c7eb27fe91734eb9eb3, user_id=85c6eafaf80543ff8ac6f349c1ea9dab, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.097637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e025f5-fbd2-43be-9cc2-764039779ede admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.098041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.113047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1242/2453] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:35 2022] PUT /identity/v3/projects/99598543ff8c4c7eb27fe91734eb9eb3/users/85c6eafaf80543ff8ac6f349c1ea9dab/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:35.164099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1212/2454] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:35 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:35.166644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.185637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.186110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.186194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.229997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] MFA Rules not processed for user `85c6eafaf80543ff8ac6f349c1ea9dab`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:35.231247 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:35.248094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:35.279357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1f36-eda9-4ef8-bd5b-a7d7575e0baa admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.336691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1213/2455] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:35.338301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.341074 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:35.364714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.365343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.365729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.366040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.366643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.368722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.406652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1243/2456] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:35 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:35.410740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.439853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e57c02-562e-4227-991a-acf98eabde8c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.442645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a309c2-1ca4-4a9c-bc5b-37a214467644 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.446259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.447202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.447971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.448278 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.448993 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.449123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] PATH_INFO: `/v3/users/33ba92af52134e7aadd45d4503bb0b2a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.449270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.450121 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.450773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.451114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ba92af52134e7aadd45d4503bb0b2a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.452928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.454382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.482230 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:35.489543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1244/2457] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:35 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:35.489543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.516632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ba92af52134e7aadd45d4503bb0b2a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:35.517372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ba92af52134e7aadd45d4503bb0b2a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:35.518010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ba92af52134e7aadd45d4503bb0b2a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:35.526106 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ba92af52134e7aadd45d4503bb0b2a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:35.540088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ba92af52134e7aadd45d4503bb0b2a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:35.557221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1214/2458] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:35 2022] DELETE /identity/v3/users/33ba92af52134e7aadd45d4503bb0b2a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:35.558333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.559312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e7874-4373-4d7b-b7b3-632bb26f8310 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.560597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:35.644716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.645326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.645612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.645887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.646534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.648165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.650777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:35.652377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f67d9-849e-4a09-9bc7-75f02818c1a2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.657492 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.658105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.658387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.658663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.659305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.661526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1245/2459] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:35.664373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.665576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.667894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:35.681061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5408c098-0076-4ead-be6e-5fcbf4742526 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.687878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.688534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.688913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.692346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.692510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1215/2460] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:35 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:35.692601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.692601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.694705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.704376 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1246/2461] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:35.706485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185e0e-d459-4b20-ab7c-a05d72d3e354 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.708722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.711893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.712722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.713409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.713847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.714682 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.716547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.719887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed9b77-b497-4ca0-ac6d-e68db98dddc5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.725517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.726190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.726471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.726741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] PATH_INFO: `/v3/projects/763cfb63e4c5458795ae17d0745dd6d6/users/96eb058db60b43e184de512d35667eb6/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.727643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1216/2462] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:35.732392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.742929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7022017-a411-4eec-86d1-5017f17c16c4 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.747563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763cfb63e4c5458795ae17d0745dd6d6, user_id=96eb058db60b43e184de512d35667eb6, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.750001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17e919-0fe2-4fb9-9289-fb1f5956ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.750242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.750666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e919-0fe2-4fb9-9289-fb1f5956ac80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.750946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e919-0fe2-4fb9-9289-fb1f5956ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.751220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17e919-0fe2-4fb9-9289-fb1f5956ac80 admin admin] PATH_INFO: `/v3/projects/32fbffb0c18a44ec902a0161cfd0f518/users/d7fa800b8da64c02b105972a2fd8126a/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.771271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1247/2463] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:35 2022] PUT /identity/v3/projects/763cfb63e4c5458795ae17d0745dd6d6/users/96eb058db60b43e184de512d35667eb6/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:35.777538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17e919-0fe2-4fb9-9289-fb1f5956ac80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fbffb0c18a44ec902a0161cfd0f518, user_id=d7fa800b8da64c02b105972a2fd8126a, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.781146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17e919-0fe2-4fb9-9289-fb1f5956ac80 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.783452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.785365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:35.801207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1217/2464] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:35 2022] PUT /identity/v3/projects/32fbffb0c18a44ec902a0161cfd0f518/users/d7fa800b8da64c02b105972a2fd8126a/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:35.802460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320730a-a7c4-4d7a-97bf-632af6c33c5c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.802760 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320730a-a7c4-4d7a-97bf-632af6c33c5c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.803011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320730a-a7c4-4d7a-97bf-632af6c33c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.833281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c320730a-a7c4-4d7a-97bf-632af6c33c5c None None] MFA Rules not processed for user `96eb058db60b43e184de512d35667eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:35.834488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c320730a-a7c4-4d7a-97bf-632af6c33c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:35.861200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187cb7f-2126-4126-955c-09a595181813 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.880476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:35.913181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1218/2465] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:35.913821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320730a-a7c4-4d7a-97bf-632af6c33c5c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:35.923810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:35.924485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:35.924763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:35.925040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] PATH_INFO: `/v3/projects/ab10015fc6334c5cb7bd356a68f42c75` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:35.926196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab10015fc6334c5cb7bd356a68f42c75)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:35.928142 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:35.980257 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320730a-a7c4-4d7a-97bf-632af6c33c5c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:35.981135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab10015fc6334c5cb7bd356a68f42c75', 'request_id': 'req-fcc67616-e6a9-450a-be66-33d08a004375'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:35.989614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab10015fc6334c5cb7bd356a68f42c75', 'request_id': 'req-fcc67616-e6a9-450a-be66-33d08a004375'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:35.998468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab10015fc6334c5cb7bd356a68f42c75', 'request_id': 'req-fcc67616-e6a9-450a-be66-33d08a004375'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:36.007093 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:36.012995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] The token cache is being invalidate because project ab10015fc6334c5cb7bd356a68f42c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:36.013595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:36.014746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:36.017795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1248/2466] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:35 2022] DELETE /identity/v3/projects/ab10015fc6334c5cb7bd356a68f42c75 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:36.019095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.021640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.044904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7b569-b261-4f0a-9cba-154e7434af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.045557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7b569-b261-4f0a-9cba-154e7434af8a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.045911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7b569-b261-4f0a-9cba-154e7434af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.046255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7b569-b261-4f0a-9cba-154e7434af8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.046998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7b569-b261-4f0a-9cba-154e7434af8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.048706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7b569-b261-4f0a-9cba-154e7434af8a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.059327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1219/2467] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:36.060632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.060917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.061192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.081582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:36.082809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.095043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1220/2468] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:36.100070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc67616-e6a9-450a-be66-33d08a004375 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.100178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.100178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.104522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4bac67-8f9a-489d-b0b2-7fd2444dbf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.105160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bac67-8f9a-489d-b0b2-7fd2444dbf6d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.105433 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bac67-8f9a-489d-b0b2-7fd2444dbf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.105697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4bac67-8f9a-489d-b0b2-7fd2444dbf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.106337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bac67-8f9a-489d-b0b2-7fd2444dbf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.108277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4bac67-8f9a-489d-b0b2-7fd2444dbf6d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.109934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377713-8212-4495-bcdd-e0f8fe611986 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.115413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2d139-4de7-4a62-a144-01dd2b8767b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.115982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2d139-4de7-4a62-a144-01dd2b8767b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.116293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2d139-4de7-4a62-a144-01dd2b8767b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.116564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2d139-4de7-4a62-a144-01dd2b8767b9 admin admin] PATH_INFO: `/v3/projects/32fbffb0c18a44ec902a0161cfd0f518/users/d7fa800b8da64c02b105972a2fd8126a/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.118906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2d139-4de7-4a62-a144-01dd2b8767b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fbffb0c18a44ec902a0161cfd0f518, user_id=d7fa800b8da64c02b105972a2fd8126a, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.121987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2d139-4de7-4a62-a144-01dd2b8767b9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.133890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1221/2469] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:36 2022] PUT /identity/v3/projects/32fbffb0c18a44ec902a0161cfd0f518/users/d7fa800b8da64c02b105972a2fd8126a/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:36.143671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce658f-dc98-4bbf-8e93-219968196709 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.143671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce658f-dc98-4bbf-8e93-219968196709 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.143671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce658f-dc98-4bbf-8e93-219968196709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.150145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1249/2470] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:36.150145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4977-0b16-462e-a677-874ac88fa963 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.150145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4977-0b16-462e-a677-874ac88fa963 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.150145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4977-0b16-462e-a677-874ac88fa963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.158562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b8ce658f-dc98-4bbf-8e93-219968196709 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:36.159819 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b8ce658f-dc98-4bbf-8e93-219968196709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.178184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d0de4977-0b16-462e-a677-874ac88fa963 None None] MFA Rules not processed for user `d7fa800b8da64c02b105972a2fd8126a`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:36.181230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d0de4977-0b16-462e-a677-874ac88fa963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.238209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1222/2471] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:36.239066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce658f-dc98-4bbf-8e93-219968196709 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.245408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:36.249503 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce658f-dc98-4bbf-8e93-219968196709 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.257897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.257897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.257897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.257897 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.258344 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.259407 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.263722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1250/2472] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:36.264623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de4977-0b16-462e-a677-874ac88fa963 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.275374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de4977-0b16-462e-a677-874ac88fa963 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.281062 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.281562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.281843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.282115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.282758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:36.283063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.284197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1223/2473] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:36.284698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.285017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.286820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.302268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1251/2474] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:36.302268 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.310604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d9cb-610d-4198-803d-34f081e4f7ff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.315871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.316507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.317220 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.317504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.318150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.319803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.334082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1252/2475] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:36.334919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.345684 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d8b90-034e-4365-a812-1b32fbd6693e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.350648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323472d-03fa-48b6-9df7-e95627416fcb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.352124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.352750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.353023 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.353327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.354199 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.354926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.355543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.355821 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.356116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.356222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.357948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.387028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1253/2476] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:36.387971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.418721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:36.423939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.425178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.435346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1224/2477] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:36.436179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.446449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a869ae03-0af9-4be8-9dc0-2e56239ef9de service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.472276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594c478-db91-42e0-b80c-b377d25bdb65 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.479104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.480133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.480340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.480619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] PATH_INFO: `/v3/projects/51e681e542ba4d0eb023cad2aeba2045/users/644ef92ad203457a88a06060d3fdfcfd/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.497905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e681e542ba4d0eb023cad2aeba2045, user_id=644ef92ad203457a88a06060d3fdfcfd, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.501108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.515862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1254/2478] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:36 2022] PUT /identity/v3/projects/51e681e542ba4d0eb023cad2aeba2045/users/644ef92ad203457a88a06060d3fdfcfd/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:36.519956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.523630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.524409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.524694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.524988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.526411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.528650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.555934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1225/2479] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/users => generated 278 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:36.560811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.573541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca8e2e-4385-485e-891b-29b3a04f7869 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.592616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c8d89-1c69-4477-ac52-19efa675ab1d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.599099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.599729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.600029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.600325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.600970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.602603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.618392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1255/2480] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:36.621414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.632345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890ce38-d199-4197-950b-4ce0513ada99 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.637493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5212a0a-afbf-4192-81d4-bd8f8caf3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.638168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5212a0a-afbf-4192-81d4-bd8f8caf3cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.638445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5212a0a-afbf-4192-81d4-bd8f8caf3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.638718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5212a0a-afbf-4192-81d4-bd8f8caf3cdc admin admin] PATH_INFO: `/v3/projects/51e681e542ba4d0eb023cad2aeba2045/users/644ef92ad203457a88a06060d3fdfcfd/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.638924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:36.640933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5212a0a-afbf-4192-81d4-bd8f8caf3cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e681e542ba4d0eb023cad2aeba2045, user_id=644ef92ad203457a88a06060d3fdfcfd, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.643695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5212a0a-afbf-4192-81d4-bd8f8caf3cdc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.656054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1256/2481] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:36 2022] PUT /identity/v3/projects/51e681e542ba4d0eb023cad2aeba2045/users/644ef92ad203457a88a06060d3fdfcfd/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:36.667457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255371d-1f45-407b-a44b-a51b1de65944 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.667911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255371d-1f45-407b-a44b-a51b1de65944 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.668604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255371d-1f45-407b-a44b-a51b1de65944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.685339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.686213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.686592 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.686996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.687736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.689809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.702495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1226/2482] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:36.710156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.711691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1255371d-1f45-407b-a44b-a51b1de65944 None None] MFA Rules not processed for user `644ef92ad203457a88a06060d3fdfcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:36.713197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1255371d-1f45-407b-a44b-a51b1de65944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:36.728282 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794f2e7-6a3f-4702-96ee-4046dd4be693 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.824414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1257/2483] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:36.842647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255371d-1f45-407b-a44b-a51b1de65944 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.848868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.849999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.850667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.851249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.852568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.856748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.864067 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:36.874099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1227/2484] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:36.878564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:36.905000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc5fa7-40b0-4bee-ada8-ffec354d66ac admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.912846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.913981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.914467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.914960 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] PATH_INFO: `/v3/projects/f545fefecd0a4100b575cfa288174263/users/50009ac917074ec6aa0028211e338221/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.923577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255371d-1f45-407b-a44b-a51b1de65944 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:36.928923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7df3b-ff2e-454b-85e2-69cb179853ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:36.930080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7df3b-ff2e-454b-85e2-69cb179853ab service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.930080 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7df3b-ff2e-454b-85e2-69cb179853ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.930615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7df3b-ff2e-454b-85e2-69cb179853ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:36.941259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7df3b-ff2e-454b-85e2-69cb179853ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.942092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f545fefecd0a4100b575cfa288174263, user_id=50009ac917074ec6aa0028211e338221, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:36.942870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7df3b-ff2e-454b-85e2-69cb179853ab service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.948185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:36.955339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1258/2485] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:36.968610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1228/2486] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:36 2022] PUT /identity/v3/projects/f545fefecd0a4100b575cfa288174263/users/50009ac917074ec6aa0028211e338221/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:36.979359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372acf-5daf-4dcc-8bd1-ee134c0189a2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:36.979560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372acf-5daf-4dcc-8bd1-ee134c0189a2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:36.979870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31372acf-5daf-4dcc-8bd1-ee134c0189a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.011266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-31372acf-5daf-4dcc-8bd1-ee134c0189a2 None None] MFA Rules not processed for user `50009ac917074ec6aa0028211e338221`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:37.013435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-31372acf-5daf-4dcc-8bd1-ee134c0189a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:37.088204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1259/2487] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:37.089102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.162570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74237f5-81bf-4b48-8130-08dac0a98823 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.167879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.168562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.168839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.169137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.169769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.171716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.200931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1229/2488] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:37 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:37.205328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31372acf-5daf-4dcc-8bd1-ee134c0189a2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.217630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31372acf-5daf-4dcc-8bd1-ee134c0189a2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.285525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.286131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.286406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.286686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.287299 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.289981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.321569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1260/2489] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:37 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:37.323487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.337007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83be476-9556-41d9-81f6-d78f1c25ce3e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.342270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.343014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.343400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.343748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.345161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.346521 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.359644 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1230/2490] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:37.366696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.379931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68de60-9932-43a0-8c34-0847857bf83e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.385543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.386256 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.386607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.386915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] PATH_INFO: `/v3/projects/743dca6b5a03493ea49252c4d3449c5c/users/d9645f7108704dfc8ffc2d3747ee91fe/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.403324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743dca6b5a03493ea49252c4d3449c5c, user_id=d9645f7108704dfc8ffc2d3747ee91fe, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.406190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.418127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.421594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1261/2491] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:37 2022] PUT /identity/v3/projects/743dca6b5a03493ea49252c4d3449c5c/users/d9645f7108704dfc8ffc2d3747ee91fe/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:37.425687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.428633 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f8339-f03a-4661-969e-4546cbe9ce36 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.438529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:37.440620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:37.489364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.490004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.490314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.490587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] PATH_INFO: `/v3/users/96eb058db60b43e184de512d35667eb6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.491745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] RBAC: Authorizing `identity:delete_user(user_id=96eb058db60b43e184de512d35667eb6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.493739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.495284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc47371-7ff3-4338-a504-9268e698ed21 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.500674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.501287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.501564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.501835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.502473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.504131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.514266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1262/2492] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:37.518532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.529914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92591-54e0-43f5-96ba-a1eb54d93b9f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.534878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e86bd1-a590-4562-984b-1f22c2b9388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.535535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e86bd1-a590-4562-984b-1f22c2b9388a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.535816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e86bd1-a590-4562-984b-1f22c2b9388a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.536133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e86bd1-a590-4562-984b-1f22c2b9388a admin admin] PATH_INFO: `/v3/projects/743dca6b5a03493ea49252c4d3449c5c/users/d9645f7108704dfc8ffc2d3747ee91fe/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.538134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e86bd1-a590-4562-984b-1f22c2b9388a admin admin] RBAC: Authorizing `identity:create_grant(project_id=743dca6b5a03493ea49252c4d3449c5c, user_id=d9645f7108704dfc8ffc2d3747ee91fe, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.540796 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e86bd1-a590-4562-984b-1f22c2b9388a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.545223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96eb058db60b43e184de512d35667eb6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:37.545955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96eb058db60b43e184de512d35667eb6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:37.546639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96eb058db60b43e184de512d35667eb6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:37.552635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1263/2493] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:37 2022] PUT /identity/v3/projects/743dca6b5a03493ea49252c4d3449c5c/users/d9645f7108704dfc8ffc2d3747ee91fe/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:37.553962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96eb058db60b43e184de512d35667eb6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:37.565190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.565479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.565763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.567948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-f73660ab-0778-4476-8131-071a2e66eaae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96eb058db60b43e184de512d35667eb6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:37.583522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1231/2494] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:37 2022] DELETE /identity/v3/users/96eb058db60b43e184de512d35667eb6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:37.588620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.588995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.589516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.596891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] MFA Rules not processed for user `d9645f7108704dfc8ffc2d3747ee91fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:37.598130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:37.610357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:37.611563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:37.675136 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1264/2495] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:37.678115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1232/2496] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:37.686339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.687729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:37.688440 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.689793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:37.726162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:37.747419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cfaf68-9745-4ac4-8532-0ffcd4414b2f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.751074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.751689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.751964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.752264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.752366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e9bb8-fed4-4bd4-beb1-3e36e20628a2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.755985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.756615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.756896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.757175 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.762851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.764135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.767510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.768994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.774081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1265/2497] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:37.780160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1233/2498] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:37.860463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:37.863044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:37.876798 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f813a9-1689-440d-b4cd-b179132259ba service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:37.881735 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:37.882530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:37.882906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:37.883279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:37.885833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:37.920889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:37.977654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:37.979898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:37.991702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1266/2499] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:38.105734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:38.107359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:38.128624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa48d-9091-432e-a891-c1e31a62867b service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:38.135781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:38.136582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:38.136935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:38.137209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] PATH_INFO: `/v3/projects/763cfb63e4c5458795ae17d0745dd6d6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:38.138555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=763cfb63e4c5458795ae17d0745dd6d6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:38.141545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:38.204285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763cfb63e4c5458795ae17d0745dd6d6', 'request_id': 'req-6103df18-2d74-4e88-9e22-0b8457edf37e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.211303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763cfb63e4c5458795ae17d0745dd6d6', 'request_id': 'req-6103df18-2d74-4e88-9e22-0b8457edf37e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.221032 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763cfb63e4c5458795ae17d0745dd6d6', 'request_id': 'req-6103df18-2d74-4e88-9e22-0b8457edf37e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.232970 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] The token cache is being invalidate because project 763cfb63e4c5458795ae17d0745dd6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:38.233263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.233892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.235373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1234/2500] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:38 2022] DELETE /identity/v3/projects/763cfb63e4c5458795ae17d0745dd6d6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:38.239495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:38.251306 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492dc9d-2188-4657-88fe-3b0e96b70b30 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:38.313626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:38.314282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:38.314570 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:38.314843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] PATH_INFO: `/v3/users/644ef92ad203457a88a06060d3fdfcfd` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:38.315978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=644ef92ad203457a88a06060d3fdfcfd)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:38.317994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:38.366909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644ef92ad203457a88a06060d3fdfcfd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.367461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644ef92ad203457a88a06060d3fdfcfd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.368097 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644ef92ad203457a88a06060d3fdfcfd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.377746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644ef92ad203457a88a06060d3fdfcfd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.391813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-af9c318a-5a78-40f7-9ebd-c5f41425c573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644ef92ad203457a88a06060d3fdfcfd'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.405334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1267/2501] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:38 2022] DELETE /identity/v3/users/644ef92ad203457a88a06060d3fdfcfd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:38.685862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:38.688191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:38.710499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103df18-2d74-4e88-9e22-0b8457edf37e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:38.768542 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:38.769165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:38.769441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:38.769711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] PATH_INFO: `/v3/projects/51e681e542ba4d0eb023cad2aeba2045` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:38.770818 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e681e542ba4d0eb023cad2aeba2045)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:38.772755 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:38.822991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e681e542ba4d0eb023cad2aeba2045', 'request_id': 'req-857b0201-c753-4325-a8e8-564c50468b46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.830121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e681e542ba4d0eb023cad2aeba2045', 'request_id': 'req-857b0201-c753-4325-a8e8-564c50468b46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.838466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e681e542ba4d0eb023cad2aeba2045', 'request_id': 'req-857b0201-c753-4325-a8e8-564c50468b46'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.839748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:38.852186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] The token cache is being invalidate because project 51e681e542ba4d0eb023cad2aeba2045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:38.852478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.853176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-857b0201-c753-4325-a8e8-564c50468b46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:38.855447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1235/2502] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:38 2022] DELETE /identity/v3/projects/51e681e542ba4d0eb023cad2aeba2045 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:38.860558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152b25-4241-4b19-96bf-7a0d118d3e38 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:38.860841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152b25-4241-4b19-96bf-7a0d118d3e38 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:38.861405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152b25-4241-4b19-96bf-7a0d118d3e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:38.880915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6a152b25-4241-4b19-96bf-7a0d118d3e38 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:38.882446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6a152b25-4241-4b19-96bf-7a0d118d3e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:38.923209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:38.946477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1268/2503] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:38.956338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d832-38ca-41c3-a52a-fccec7987cb3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:38.956622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d832-38ca-41c3-a52a-fccec7987cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:38.956899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d832-38ca-41c3-a52a-fccec7987cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:38.980250 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-11f8d832-38ca-41c3-a52a-fccec7987cb3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:38.981494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-11f8d832-38ca-41c3-a52a-fccec7987cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:38.989638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1236/2504] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:38.993897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a152b25-4241-4b19-96bf-7a0d118d3e38 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.003677 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a152b25-4241-4b19-96bf-7a0d118d3e38 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.008428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.009036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.009334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.010221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.010871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:39.011259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.012794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.024537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1269/2505] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:39.029858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d832-38ca-41c3-a52a-fccec7987cb3 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.039069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d832-38ca-41c3-a52a-fccec7987cb3 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.043698 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.044320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.044596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.044866 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.045527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.047426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.076092 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1237/2506] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:39 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:39.080511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.091625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608527e-5b53-4003-a12c-17a0a928a700 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.118563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.120357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.151056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.151558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.151827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.152141 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.152793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.154883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.185464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1270/2507] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:39 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:39.186498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.192126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141519c2-a111-4cc2-a111-b179e4a3f6ea admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.198181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f164c275-1766-4b93-9679-4bb9745c9cd3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.198625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.199298 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.199579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.200130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] PATH_INFO: `/v3/users/85c6eafaf80543ff8ac6f349c1ea9dab` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.201488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c6eafaf80543ff8ac6f349c1ea9dab)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.203406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.208332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.209129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.209409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.210580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.211230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.213485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.230123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1271/2508] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:39.231261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.243142 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2dc84-cc06-4469-a8e9-5784b4119691 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.249039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.249784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.250065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.250332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.251127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.252714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.264362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1272/2509] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:39.268574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.268728 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c6eafaf80543ff8ac6f349c1ea9dab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:39.269506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c6eafaf80543ff8ac6f349c1ea9dab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:39.270272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c6eafaf80543ff8ac6f349c1ea9dab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:39.280457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c6eafaf80543ff8ac6f349c1ea9dab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:39.282047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8c509-f36b-45ab-807d-62d79b87b4bf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.287511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed50a6e-405d-43bf-b47f-82bf467bac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.288290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed50a6e-405d-43bf-b47f-82bf467bac81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.288697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed50a6e-405d-43bf-b47f-82bf467bac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.289045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed50a6e-405d-43bf-b47f-82bf467bac81 admin admin] PATH_INFO: `/v3/projects/cfa8aa8e204b4f0d944929095b7ec2c5/users/242bf5e708f04955b70ec4781b51ae1f/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.300736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc17423c-a15b-4db6-aa53-dec955519558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c6eafaf80543ff8ac6f349c1ea9dab'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:39.305996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed50a6e-405d-43bf-b47f-82bf467bac81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa8aa8e204b4f0d944929095b7ec2c5, user_id=242bf5e708f04955b70ec4781b51ae1f, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.312395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed50a6e-405d-43bf-b47f-82bf467bac81 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.325697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1238/2510] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:39 2022] DELETE /identity/v3/users/85c6eafaf80543ff8ac6f349c1ea9dab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:39.330207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.330679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.331218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.346875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1273/2511] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:39 2022] PUT /identity/v3/projects/cfa8aa8e204b4f0d944929095b7ec2c5/users/242bf5e708f04955b70ec4781b51ae1f/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:39.349115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.349594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.350101 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.359304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:39.361508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.382338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] MFA Rules not processed for user `242bf5e708f04955b70ec4781b51ae1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:39.383586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.402164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:39.435642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1239/2512] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:39.446723 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.449832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.458338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1274/2513] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:39.463284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.465000 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.473775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:39.482060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe99a-3243-4b65-a32a-d7f1fa1aac2b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.487650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.488282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.488559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.488835 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.489480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.491328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.511055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bbb35-c994-407d-bb8e-518d39e3b693 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.515327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.515969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.516294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.516605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.522485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1275/2514] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:39 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:39.523520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.527588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.529104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.539320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1240/2515] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:39.590381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532bc54-c45b-4561-8c3c-25d8acf75605 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.595383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.595976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.596282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.596560 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.597191 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.599154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.624900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1276/2516] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:39 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:39.629118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.642885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a51d0-9ebc-491c-a866-616d6b9f34fe service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.648307 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.648934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.649204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.649468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.650226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.653129 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.663396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1241/2517] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:39.669038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.679926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2530877-fe29-40e4-b9fe-5c1ca7de0fcf admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.686528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.687197 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.687478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.688075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] PATH_INFO: `/v3/projects/c6ed7aaaee72425c8aeb2f5dc48e6abe/users/9f55b37446b646c9b00fa6df01b852ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.705471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ed7aaaee72425c8aeb2f5dc48e6abe, user_id=9f55b37446b646c9b00fa6df01b852ad, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.708960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.723439 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1277/2518] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:39 2022] PUT /identity/v3/projects/c6ed7aaaee72425c8aeb2f5dc48e6abe/users/9f55b37446b646c9b00fa6df01b852ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:39.727443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.738445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddad8ad-f603-4127-a4f6-6b7c38002ec0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.799208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.799815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.800158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.800404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.801042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.802641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.815037 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1242/2519] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:39.819293 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.830516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18587a-391a-4de4-b6f3-dcf526b0a5f5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.833570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.835436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db42b7-d234-4d77-9b63-b1a56cd4292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.835576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.836147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db42b7-d234-4d77-9b63-b1a56cd4292a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.836425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db42b7-d234-4d77-9b63-b1a56cd4292a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.836696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db42b7-d234-4d77-9b63-b1a56cd4292a admin admin] PATH_INFO: `/v3/projects/c6ed7aaaee72425c8aeb2f5dc48e6abe/users/9f55b37446b646c9b00fa6df01b852ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.839184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db42b7-d234-4d77-9b63-b1a56cd4292a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ed7aaaee72425c8aeb2f5dc48e6abe, user_id=9f55b37446b646c9b00fa6df01b852ad, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.841871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db42b7-d234-4d77-9b63-b1a56cd4292a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.853171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf11bee-2d8f-4e1f-9f49-182cedf12464 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:39.855511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1278/2520] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:39 2022] PUT /identity/v3/projects/c6ed7aaaee72425c8aeb2f5dc48e6abe/users/9f55b37446b646c9b00fa6df01b852ad/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:39.865493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.865784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.866060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.896215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] MFA Rules not processed for user `9f55b37446b646c9b00fa6df01b852ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:39.897426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.920278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:39.920815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:39.921098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:39.921373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] PATH_INFO: `/v3/projects/99598543ff8c4c7eb27fe91734eb9eb3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:39.922514 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=99598543ff8c4c7eb27fe91734eb9eb3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:39.924474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:39.937283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:39.971990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1279/2521] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:39.980448 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99598543ff8c4c7eb27fe91734eb9eb3', 'request_id': 'req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:39.984039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:39.985713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:39.987655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99598543ff8c4c7eb27fe91734eb9eb3', 'request_id': 'req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:39.997016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99598543ff8c4c7eb27fe91734eb9eb3', 'request_id': 'req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.007633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:40.008197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] The token cache is being invalidate because project 99598543ff8c4c7eb27fe91734eb9eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:40.008197 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.008827 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.010616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1243/2522] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:39 2022] DELETE /identity/v3/projects/99598543ff8c4c7eb27fe91734eb9eb3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:40.014513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:40.016204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:40.048923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51cbf0-a0f4-4e5b-9aa9-d0552cb6535d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:40.085368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe0501-83a1-42b6-a18e-08dd8d0eb9ae admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:40.091541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:40.092228 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:40.092498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:40.092773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] PATH_INFO: `/v3/users/d7fa800b8da64c02b105972a2fd8126a` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:40.093953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fa800b8da64c02b105972a2fd8126a)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:40.095935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:40.101815 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:40.102465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:40.102817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:40.103193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:40.105783 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:40.151323 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fa800b8da64c02b105972a2fd8126a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.152612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fa800b8da64c02b105972a2fd8126a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.153393 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fa800b8da64c02b105972a2fd8126a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.162630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fa800b8da64c02b105972a2fd8126a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.172744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:40.174113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:40.177568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-2fa1a5d0-c0bb-410f-9212-bdb0cfa81433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fa800b8da64c02b105972a2fd8126a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.185041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1280/2523] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:40.192595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1244/2524] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:40 2022] DELETE /identity/v3/users/d7fa800b8da64c02b105972a2fd8126a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:40.536612 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:40.563954 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a3fc1-6430-4f63-9669-8568c5b2daf3 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:40.648854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:40.649497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:40.649775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:40.650782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] PATH_INFO: `/v3/projects/32fbffb0c18a44ec902a0161cfd0f518` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:40.652096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fbffb0c18a44ec902a0161cfd0f518)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:40.654119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:40.842261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:40.861134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fbffb0c18a44ec902a0161cfd0f518', 'request_id': 'req-1614f99f-41e3-43ea-b0b9-e2dce0955253'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.867844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fbffb0c18a44ec902a0161cfd0f518', 'request_id': 'req-1614f99f-41e3-43ea-b0b9-e2dce0955253'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.876497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fbffb0c18a44ec902a0161cfd0f518', 'request_id': 'req-1614f99f-41e3-43ea-b0b9-e2dce0955253'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.889769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] The token cache is being invalidate because project 32fbffb0c18a44ec902a0161cfd0f518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:40.890132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.891028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1614f99f-41e3-43ea-b0b9-e2dce0955253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:40.893107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1281/2525] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:40 2022] DELETE /identity/v3/projects/32fbffb0c18a44ec902a0161cfd0f518 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:40.898340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6bed-5f4c-49a8-97d6-2b6e165aeecc None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:40.898864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6bed-5f4c-49a8-97d6-2b6e165aeecc None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:40.898864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6bed-5f4c-49a8-97d6-2b6e165aeecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:40.920303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5a2d6bed-5f4c-49a8-97d6-2b6e165aeecc None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:40.921517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5a2d6bed-5f4c-49a8-97d6-2b6e165aeecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:40.934390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:40.988950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1245/2526] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:40.997980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6839a-8c2d-4fcd-8531-477c966ea32b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:40.998261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6839a-8c2d-4fcd-8531-477c966ea32b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:40.998525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6839a-8c2d-4fcd-8531-477c966ea32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.019908 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-96c6839a-8c2d-4fcd-8531-477c966ea32b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:41.021217 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-96c6839a-8c2d-4fcd-8531-477c966ea32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:41.030157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1282/2527] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:41.034696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6bed-5f4c-49a8-97d6-2b6e165aeecc None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:41.045539 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6bed-5f4c-49a8-97d6-2b6e165aeecc None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:41.050527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:41.051136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.051418 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.051694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.052419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:41.052724 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:41.054346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:41.066929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1246/2528] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:41.071252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6839a-8c2d-4fcd-8531-477c966ea32b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:41.080845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6839a-8c2d-4fcd-8531-477c966ea32b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:41.086078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:41.086941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.086941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.087231 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.087873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:41.089857 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:41.118979 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1283/2529] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:41 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:41.123993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:41.137425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6b85-8e89-4773-9d23-49f5dbcc1467 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:41.196737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:41.199268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.199268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.199268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.199268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:41.201008 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:41.229686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1247/2530] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:41 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:41.234064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:41.245930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b28380-9469-43a1-95f9-1ec9d4409c8e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:41.250478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:41.251072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.251341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.251609 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.252269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:41.253894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:41.264716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1284/2531] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:41.268946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:41.280447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c2d28-e75e-460a-988d-ac549075a75e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:41.286083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5674d4-4a02-4813-be32-b5b5ea192e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:41.286652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5674d4-4a02-4813-be32-b5b5ea192e63 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.287036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5674d4-4a02-4813-be32-b5b5ea192e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.287194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5674d4-4a02-4813-be32-b5b5ea192e63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.287846 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5674d4-4a02-4813-be32-b5b5ea192e63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:41.289625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5674d4-4a02-4813-be32-b5b5ea192e63 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:41.301862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1248/2532] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:41.306099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:41.316672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149384f9-35e4-4866-8f31-87fb720fa155 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:41.321484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:41.322247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.322586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.322972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] PATH_INFO: `/v3/projects/8b7ea596808f40dfb78119149607b723/users/883f296ed3d0423485aa4fce1f3fd9a6/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.339171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b7ea596808f40dfb78119149607b723, user_id=883f296ed3d0423485aa4fce1f3fd9a6, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:41.341911 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:41.356205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1285/2533] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:41 2022] PUT /identity/v3/projects/8b7ea596808f40dfb78119149607b723/users/883f296ed3d0423485aa4fce1f3fd9a6/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:41.366497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.366779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.367058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.396368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] MFA Rules not processed for user `883f296ed3d0423485aa4fce1f3fd9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:41.397597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:41.465247 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1249/2534] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:41.477039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:41.478948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:41.536628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ad4a-e09b-4ab0-83cf-f09f93b96a72 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:41.540168 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:41.541279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:41.541559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:41.541828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:41.550166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:41.551820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:41.562334 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1286/2535] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:42.840621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:42.842065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:42.857704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:42.904729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021be0e-b3c8-439a-acc2-f2e304bd811c None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:42.908381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293cfca-019e-4923-85a9-72436b092d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:42.908995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cfca-019e-4923-85a9-72436b092d30 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:42.909276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cfca-019e-4923-85a9-72436b092d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:42.909551 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293cfca-019e-4923-85a9-72436b092d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:42.911296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0293cfca-019e-4923-85a9-72436b092d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:42.986658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cfca-019e-4923-85a9-72436b092d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:42.989311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293cfca-019e-4923-85a9-72436b092d30 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:43.001552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1250/2536] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:51.558024 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:52.996706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=44 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:53.661963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:53.663579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:53.764091 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5a0e-ba37-4ccb-b4dc-2215863bf3c9 service glance] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:53.769529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:53.770545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:53.777054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:53.777054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] PATH_INFO: `/v3/users/50009ac917074ec6aa0028211e338221` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:53.777054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50009ac917074ec6aa0028211e338221)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:53.777054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:53.850822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50009ac917074ec6aa0028211e338221'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:53.851485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50009ac917074ec6aa0028211e338221'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:53.852207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50009ac917074ec6aa0028211e338221'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:53.862033 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50009ac917074ec6aa0028211e338221'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:53.877204 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50009ac917074ec6aa0028211e338221'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:53.891785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1287/2537] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:53 2022] DELETE /identity/v3/users/50009ac917074ec6aa0028211e338221 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:53.896502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:53.896789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:53.897095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:53.917670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:53.918892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:54.002809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1251/2538] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:54.012762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:54.014240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:54.082499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d8104-6043-4fb4-8cb1-0fab820c893b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:54.086514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:54.087148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:54.087426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:54.087741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:54.097690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:54.099262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:54.116406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1288/2539] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:54.430598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:54.432690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:54.449823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6945b-332d-4647-b7ba-6734436f2467 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:54.454993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:54.455544 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:54.455830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:54.456130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] PATH_INFO: `/v3/projects/f545fefecd0a4100b575cfa288174263` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:54.457316 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f545fefecd0a4100b575cfa288174263)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:54.459358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:54.522275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f545fefecd0a4100b575cfa288174263', 'request_id': 'req-dc32cf8a-c949-47d4-9610-a030b4b31f9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.530689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f545fefecd0a4100b575cfa288174263', 'request_id': 'req-dc32cf8a-c949-47d4-9610-a030b4b31f9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.540394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f545fefecd0a4100b575cfa288174263', 'request_id': 'req-dc32cf8a-c949-47d4-9610-a030b4b31f9a'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.553588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] The token cache is being invalidate because project f545fefecd0a4100b575cfa288174263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:54.553878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.554548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.556157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1252/2540] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:54 2022] DELETE /identity/v3/projects/f545fefecd0a4100b575cfa288174263 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:54.560386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:54.571676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b3bb-d3cc-4072-8d40-d73e37ab305c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:54.592578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:54.640486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:54.641129 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:54.641407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:54.641678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] PATH_INFO: `/v3/users/d9645f7108704dfc8ffc2d3747ee91fe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:54.643094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9645f7108704dfc8ffc2d3747ee91fe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:54.645211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:54.700221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9645f7108704dfc8ffc2d3747ee91fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.701290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9645f7108704dfc8ffc2d3747ee91fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.707848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9645f7108704dfc8ffc2d3747ee91fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.718620 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9645f7108704dfc8ffc2d3747ee91fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.731540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-b91a6aa1-f757-42c3-83cf-cae8ac0ab694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9645f7108704dfc8ffc2d3747ee91fe'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:54.748341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1289/2541] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:54 2022] DELETE /identity/v3/users/d9645f7108704dfc8ffc2d3747ee91fe => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:55.362413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:55.363878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:55.386310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32cf8a-c949-47d4-9610-a030b4b31f9a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:55.466011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:55.466804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.467260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.467502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] PATH_INFO: `/v3/projects/743dca6b5a03493ea49252c4d3449c5c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.469214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743dca6b5a03493ea49252c4d3449c5c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:55.471164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:55.509251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:55.534901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743dca6b5a03493ea49252c4d3449c5c', 'request_id': 'req-09902574-61eb-414e-9019-4317a5ec04c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:55.541590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743dca6b5a03493ea49252c4d3449c5c', 'request_id': 'req-09902574-61eb-414e-9019-4317a5ec04c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:55.554396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743dca6b5a03493ea49252c4d3449c5c', 'request_id': 'req-09902574-61eb-414e-9019-4317a5ec04c9'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:55.567085 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] The token cache is being invalidate because project 743dca6b5a03493ea49252c4d3449c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:55.567460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:55.568584 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-09902574-61eb-414e-9019-4317a5ec04c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:55.574010 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1253/2542] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:55 2022] DELETE /identity/v3/projects/743dca6b5a03493ea49252c4d3449c5c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:55.576270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c878e9-f52b-4f24-9bc3-10842a2f4c54 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.576823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c878e9-f52b-4f24-9bc3-10842a2f4c54 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.577262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c878e9-f52b-4f24-9bc3-10842a2f4c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.606991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-92c878e9-f52b-4f24-9bc3-10842a2f4c54 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:55.608275 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-92c878e9-f52b-4f24-9bc3-10842a2f4c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:55.677878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1290/2543] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:55.685825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1c911-1761-44ce-a9aa-8cd8c305cb26 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.686112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1c911-1761-44ce-a9aa-8cd8c305cb26 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.686499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1c911-1761-44ce-a9aa-8cd8c305cb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.708103 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-67f1c911-1761-44ce-a9aa-8cd8c305cb26 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:55.709365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-67f1c911-1761-44ce-a9aa-8cd8c305cb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:55.718600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1254/2544] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:55.726517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c878e9-f52b-4f24-9bc3-10842a2f4c54 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:55.737638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c878e9-f52b-4f24-9bc3-10842a2f4c54 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:55.743030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:55.743647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.744420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.744707 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.745384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:55.745688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:55.747297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:55.761099 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1291/2545] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:55.765528 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1c911-1761-44ce-a9aa-8cd8c305cb26 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:55.775229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1c911-1761-44ce-a9aa-8cd8c305cb26 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:55.780953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:55.781556 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.781840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.782114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.782801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:55.784759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:55.821214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1255/2546] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:55 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:55.826619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:55.839348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea13fc7-c8a6-453e-aeba-7719d7b9b995 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:55.870480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:55.908676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:55.909295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.909683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.909862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.910479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:55.912598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:55.937328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1292/2547] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:55 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:55.942033 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:55.953526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a840097-67d8-4cc3-af2e-f91a2d375396 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:55.958305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:55.958906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.959191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.959458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.960130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:55.961747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:55.973396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1256/2548] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:55.977962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:55.989892 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dc90d-0608-4c34-b83c-33b4554ee9e9 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:55.996700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:55.997325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:55.997603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:55.997879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:55.998543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.000166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.012460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1293/2549] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:56.017788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.030188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d93e35-9cf5-4710-83c2-b6d5b6262c46 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.035378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b4c7b-6c26-45e2-8d45-763ff09fb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.036059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b4c7b-6c26-45e2-8d45-763ff09fb3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.036385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b4c7b-6c26-45e2-8d45-763ff09fb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.036689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b4c7b-6c26-45e2-8d45-763ff09fb3a5 admin admin] PATH_INFO: `/v3/projects/eb63e6e85ce54122aa1594a898719a08/users/817addf71f3f49c2bd944e8938bd655f/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.053573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.055461 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:56.060712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b4c7b-6c26-45e2-8d45-763ff09fb3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb63e6e85ce54122aa1594a898719a08, user_id=817addf71f3f49c2bd944e8938bd655f, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.063435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b4c7b-6c26-45e2-8d45-763ff09fb3a5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.069847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53adc8-0ae1-4bab-b0cd-e1bba080611b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.076510 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.077500 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.077941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.078563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] PATH_INFO: `/v3/users/242bf5e708f04955b70ec4781b51ae1f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.080254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242bf5e708f04955b70ec4781b51ae1f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.081454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1257/2550] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:56 2022] PUT /identity/v3/projects/eb63e6e85ce54122aa1594a898719a08/users/817addf71f3f49c2bd944e8938bd655f/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:56.082545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.093943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.094499 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.095447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.141745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] MFA Rules not processed for user `817addf71f3f49c2bd944e8938bd655f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:56.144335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:56.146615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242bf5e708f04955b70ec4781b51ae1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:56.147318 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242bf5e708f04955b70ec4781b51ae1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:56.147980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242bf5e708f04955b70ec4781b51ae1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:56.160949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242bf5e708f04955b70ec4781b51ae1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:56.179156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e5d3a7d2-06a7-4718-9f6f-3ee096066899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242bf5e708f04955b70ec4781b51ae1f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:56.197472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1294/2551] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:56 2022] DELETE /identity/v3/users/242bf5e708f04955b70ec4781b51ae1f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:56.202655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.202917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.203149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.225163 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:56.226710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:56.237121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1258/2552] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:56.242862 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.245716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:56.301641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:56.311150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1295/2553] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:07:56.322286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.323839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:56.341345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99255a03-c161-48cd-9031-31a3bd6917d7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.346370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.346999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.347302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.347538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.348357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.350456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.360152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:56.388696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1259/2554] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:56 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:56.395191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.406710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525bf5b-c832-477a-9bb3-07aadc7c6817 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.474261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611a227-6906-418d-b842-14765e428b2b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.481116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.481870 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.482280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.482674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.483237 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.483416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.483848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.484184 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.484459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.485932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.495325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.497002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.508863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1296/2555] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:56.519431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1260/2556] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:56 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:56.520731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.531343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7cdd7-0b1c-4756-bff5-1bfb251e8647 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.537030 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.537642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.537916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.538185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.538822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.540436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.553111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1297/2557] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:56.555930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.575937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702449bc-b50f-4729-953a-71ef1260498e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.583372 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.584100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.584416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.584702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] PATH_INFO: `/v3/projects/4c6c756a4e204c77a766940f85aba4d9/users/7b2eb01dc6344a88bebebe951f05c9ea/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.602108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6c756a4e204c77a766940f85aba4d9, user_id=7b2eb01dc6344a88bebebe951f05c9ea, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.605127 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.621619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1261/2558] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:56 2022] PUT /identity/v3/projects/4c6c756a4e204c77a766940f85aba4d9/users/7b2eb01dc6344a88bebebe951f05c9ea/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:56.626090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.640792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94a958-55c4-4e45-aac6-ad8b2800f2fc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.727689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57e94c-3703-48db-a3ba-0878fb8b562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.728438 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e94c-3703-48db-a3ba-0878fb8b562c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.728608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e94c-3703-48db-a3ba-0878fb8b562c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.729769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57e94c-3703-48db-a3ba-0878fb8b562c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.729945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e94c-3703-48db-a3ba-0878fb8b562c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.731827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57e94c-3703-48db-a3ba-0878fb8b562c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.745266 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1298/2559] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:56.749848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.763575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c631d-cffe-4a0f-b6c4-64158cba5a87 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:56.769883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:56.770571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.770849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.771154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] PATH_INFO: `/v3/projects/4c6c756a4e204c77a766940f85aba4d9/users/7b2eb01dc6344a88bebebe951f05c9ea/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.773433 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6c756a4e204c77a766940f85aba4d9, user_id=7b2eb01dc6344a88bebebe951f05c9ea, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:56.778077 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:56.793335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1262/2560] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:56 2022] PUT /identity/v3/projects/4c6c756a4e204c77a766940f85aba4d9/users/7b2eb01dc6344a88bebebe951f05c9ea/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:56.804367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:56.804745 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:56.804934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:56.842384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] MFA Rules not processed for user `7b2eb01dc6344a88bebebe951f05c9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:56.843749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:56.881976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:56.885950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:56.933863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:56.986803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1299/2561] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:57.004232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:57.009738 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:57.015017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fedd2d-4bf4-4093-bf04-3fe5748fbf4b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:57.022332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:57.023274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:57.023700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:57.024190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] PATH_INFO: `/v3/projects/cfa8aa8e204b4f0d944929095b7ec2c5` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:57.026732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa8aa8e204b4f0d944929095b7ec2c5)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:57.029409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:57.058829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:57.099456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa8aa8e204b4f0d944929095b7ec2c5', 'request_id': 'req-db7e9693-a845-4017-8f1c-385d2246bade'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.109164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa8aa8e204b4f0d944929095b7ec2c5', 'request_id': 'req-db7e9693-a845-4017-8f1c-385d2246bade'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.114221 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e70c6f-98f1-46a9-8e07-e8879c39ac0d None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:57.118142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa8aa8e204b4f0d944929095b7ec2c5', 'request_id': 'req-db7e9693-a845-4017-8f1c-385d2246bade'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.133042 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] The token cache is being invalidate because project cfa8aa8e204b4f0d944929095b7ec2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:57.133370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.134204 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.135952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1263/2562] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:56 2022] DELETE /identity/v3/projects/cfa8aa8e204b4f0d944929095b7ec2c5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:57.140443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:57.141887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:57.179173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:57.179819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:57.180309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:57.180626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:57.183036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:57.218886 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e9693-a845-4017-8f1c-385d2246bade admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:57.224545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:57.225202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:57.225483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:57.225758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] PATH_INFO: `/v3/users/9f55b37446b646c9b00fa6df01b852ad` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:57.226954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f55b37446b646c9b00fa6df01b852ad)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:57.229872 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:57.265379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:57.267449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:57.282826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1300/2563] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:57.294994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f55b37446b646c9b00fa6df01b852ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.295906 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f55b37446b646c9b00fa6df01b852ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.296920 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f55b37446b646c9b00fa6df01b852ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.308874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f55b37446b646c9b00fa6df01b852ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.326884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1429b1cd-7a05-433c-824e-e1b29abc2817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f55b37446b646c9b00fa6df01b852ad'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.344663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1264/2564] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:07:57 2022] DELETE /identity/v3/users/9f55b37446b646c9b00fa6df01b852ad => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:57.754503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:57.776752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f570832-ae61-4d03-8174-e29110ce367a service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:57.851922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:57.852638 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:57.853271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:57.854117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] PATH_INFO: `/v3/projects/c6ed7aaaee72425c8aeb2f5dc48e6abe` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:57.855311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ed7aaaee72425c8aeb2f5dc48e6abe)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:57.857269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:57.858956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:57.911674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ed7aaaee72425c8aeb2f5dc48e6abe', 'request_id': 'req-538bda1c-ce85-46d6-877f-df3f593fa53d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.926894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ed7aaaee72425c8aeb2f5dc48e6abe', 'request_id': 'req-538bda1c-ce85-46d6-877f-df3f593fa53d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.937078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ed7aaaee72425c8aeb2f5dc48e6abe', 'request_id': 'req-538bda1c-ce85-46d6-877f-df3f593fa53d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.950705 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] The token cache is being invalidate because project c6ed7aaaee72425c8aeb2f5dc48e6abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:07:57.951095 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.951843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-538bda1c-ce85-46d6-877f-df3f593fa53d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:07:57.953588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1301/2565] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:07:57 2022] DELETE /identity/v3/projects/c6ed7aaaee72425c8aeb2f5dc48e6abe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:57.959431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78ce4d-4242-41a2-8fb1-1533cd7cd4a2 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:57.960781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78ce4d-4242-41a2-8fb1-1533cd7cd4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:57.960781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78ce4d-4242-41a2-8fb1-1533cd7cd4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:57.991104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5f78ce4d-4242-41a2-8fb1-1533cd7cd4a2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:57.992449 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5f78ce4d-4242-41a2-8fb1-1533cd7cd4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:58.019294 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:58.077540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1265/2566] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:58.086175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606fa6-03f8-4cbe-add3-dc01d0387c27 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.086488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606fa6-03f8-4cbe-add3-dc01d0387c27 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.086865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606fa6-03f8-4cbe-add3-dc01d0387c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.109311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7f606fa6-03f8-4cbe-add3-dc01d0387c27 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:58.110589 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7f606fa6-03f8-4cbe-add3-dc01d0387c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:58.122821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1302/2567] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:58.128263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78ce4d-4242-41a2-8fb1-1533cd7cd4a2 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.143122 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78ce4d-4242-41a2-8fb1-1533cd7cd4a2 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.159220 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.159937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.160245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.160601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.161302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:07:58.161582 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.163217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.183327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1266/2568] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:07:58.196249 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606fa6-03f8-4cbe-add3-dc01d0387c27 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.206909 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606fa6-03f8-4cbe-add3-dc01d0387c27 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.213841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.214472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.214776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.215049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.215697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.217671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.255305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1303/2569] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:58 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:58.259974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.273624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0c59e-eccc-4831-9100-456f43a29f51 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.346387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.346917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.347202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.347474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.348160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.350186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.376317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1267/2570] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:58 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:58.380924 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.392118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6864a-11c0-46b5-9ca9-510495151910 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.397568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.398210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.398488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.398806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.399809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.404234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.418873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1304/2571] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:58.424073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.436321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234771cf-5994-4648-968d-c8e23122472c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.441117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906ee60-851f-495a-92e7-f404d8f44a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.441742 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906ee60-851f-495a-92e7-f404d8f44a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.442028 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906ee60-851f-495a-92e7-f404d8f44a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.442297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906ee60-851f-495a-92e7-f404d8f44a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.442954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906ee60-851f-495a-92e7-f404d8f44a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.444623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906ee60-851f-495a-92e7-f404d8f44a3a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.456988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1268/2572] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:58.461397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.475366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926f3a7-3aa6-4e63-aad6-b8160c567715 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.481473 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.482164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.482442 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.482720 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] PATH_INFO: `/v3/projects/a47927d7b5c04dbcaa913d323e1556ce/users/31275d6f3a814d02ac1d9a77fea964a8/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.505926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47927d7b5c04dbcaa913d323e1556ce, user_id=31275d6f3a814d02ac1d9a77fea964a8, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.508737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.528239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1305/2573] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:58 2022] PUT /identity/v3/projects/a47927d7b5c04dbcaa913d323e1556ce/users/31275d6f3a814d02ac1d9a77fea964a8/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:58.538863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14111466-2c5f-4c25-8b4f-1da91841d018 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.539483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14111466-2c5f-4c25-8b4f-1da91841d018 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.539483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14111466-2c5f-4c25-8b4f-1da91841d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.570982 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-14111466-2c5f-4c25-8b4f-1da91841d018 None None] MFA Rules not processed for user `31275d6f3a814d02ac1d9a77fea964a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:58.572563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-14111466-2c5f-4c25-8b4f-1da91841d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:58.657040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1269/2574] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:58.662279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.737020 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa869a-528a-4625-ba6c-07d1c2e77b9a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.742061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.742680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.742961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.743243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.744502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.746492 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.778486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1306/2575] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:07:58 2022] POST /identity/v3/projects => generated 401 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:07:58.784169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14111466-2c5f-4c25-8b4f-1da91841d018 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.796748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14111466-2c5f-4c25-8b4f-1da91841d018 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.828448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.832100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:58.832768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:58.851271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:58.885488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.886158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.886531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.886753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.887464 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.889596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.911290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15729ae-6731-478c-9707-5dd0046808de admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.915020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1270/2576] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:07:58 2022] POST /identity/v3/users => generated 307 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:07:58.918752 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.919440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.919768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.919940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.920211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.922509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:58.930987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98872610-a0a6-4060-a2ee-6ab2fe14be9b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.937462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.938081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.938409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.938670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:58.939445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:58.941494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:58.954369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1271/2577] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:07:58.959040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:58.971055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edb835-bd2b-4d96-b67f-634ff27087c8 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:58.980155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:58.981263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:58.981712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:58.982168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] PATH_INFO: `/v3/projects/27d587b3e9d943c09c16a0d5ad5f73e6/users/603af6df94b0470d9dd1bdc8291fb248/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:59.010327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d587b3e9d943c09c16a0d5ad5f73e6, user_id=603af6df94b0470d9dd1bdc8291fb248, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:59.013554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:59.027456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:59.029128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:59.032845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1272/2578] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:58 2022] PUT /identity/v3/projects/27d587b3e9d943c09c16a0d5ad5f73e6/users/603af6df94b0470d9dd1bdc8291fb248/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:07:59.038428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:59.044564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1307/2579] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:07:59.143168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d06d94-c9a8-4909-9f09-7c401b6e456f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:59.147811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077100b-9dcf-4c37-8596-708be5526c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:59.148454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077100b-9dcf-4c37-8596-708be5526c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:59.148735 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077100b-9dcf-4c37-8596-708be5526c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:59.148999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077100b-9dcf-4c37-8596-708be5526c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:59.149645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077100b-9dcf-4c37-8596-708be5526c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:59.152739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077100b-9dcf-4c37-8596-708be5526c9f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:59.169084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1273/2580] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:07:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:07:59.171149 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:59.190854 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113f06c-854d-4fcb-acc9-5ad81d2a12ca service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:59.204840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:59.206050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:59.207012 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:59.207012 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] PATH_INFO: `/v3/projects/27d587b3e9d943c09c16a0d5ad5f73e6/users/603af6df94b0470d9dd1bdc8291fb248/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:59.210962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d587b3e9d943c09c16a0d5ad5f73e6, user_id=603af6df94b0470d9dd1bdc8291fb248, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:59.216814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:59.234948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1308/2581] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:07:59 2022] PUT /identity/v3/projects/27d587b3e9d943c09c16a0d5ad5f73e6/users/603af6df94b0470d9dd1bdc8291fb248/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:07:59.254712 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0021f-5288-43d1-a7b9-f53f36c30160 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:59.255000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0021f-5288-43d1-a7b9-f53f36c30160 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:59.255273 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0021f-5288-43d1-a7b9-f53f36c30160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:59.303004 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-6dc0021f-5288-43d1-a7b9-f53f36c30160 None None] MFA Rules not processed for user `603af6df94b0470d9dd1bdc8291fb248`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:07:59.304367 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6dc0021f-5288-43d1-a7b9-f53f36c30160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:59.395838 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:07:59.403777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1274/2582] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:07:59 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:07:59.416819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:59.418696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:07:59.483631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ac8aa-fc4c-42d5-9901-5c4f9e1cb1df admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:59.487365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:59.487975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:59.488288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:59.488561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:59.498960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:59.500478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:59.511736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1309/2583] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:59 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:07:59.598444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0021f-5288-43d1-a7b9-f53f36c30160 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:07:59.609836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0021f-5288-43d1-a7b9-f53f36c30160 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:07:59.613873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998713a-8848-448b-840f-1cf96c35492f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:07:59.614488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998713a-8848-448b-840f-1cf96c35492f service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:07:59.614761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998713a-8848-448b-840f-1cf96c35492f service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:07:59.615025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998713a-8848-448b-840f-1cf96c35492f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:07:59.684445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998713a-8848-448b-840f-1cf96c35492f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:07:59.685800 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998713a-8848-448b-840f-1cf96c35492f service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:07:59.695224 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1275/2584] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:07:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:03.118236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:03.120577 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:03.187848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:03.206822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7bcf2-f26c-44e7-8534-9c66495d1d97 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:03.211995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:03.212751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:03.213026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:03.213409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] PATH_INFO: `/v3/users/817addf71f3f49c2bd944e8938bd655f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:03.214601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=817addf71f3f49c2bd944e8938bd655f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:03.216607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:03.284060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '817addf71f3f49c2bd944e8938bd655f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:03.284802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '817addf71f3f49c2bd944e8938bd655f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:03.286133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '817addf71f3f49c2bd944e8938bd655f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:03.299102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '817addf71f3f49c2bd944e8938bd655f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:03.320825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '817addf71f3f49c2bd944e8938bd655f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:03.342622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1310/2585] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:03 2022] DELETE /identity/v3/users/817addf71f3f49c2bd944e8938bd655f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:03.349310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:03.350749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:03.351271 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:03.381978 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:03.384567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:03.488956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1276/2586] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:03.499771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:03.501263 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:03.593186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004cdf6-9ffb-4638-b998-3c739e936454 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:03.599232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:03.600841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:03.600841 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:03.601406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:03.617378 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:03.620361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:03.639227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1311/2587] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:04.061711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:04.064110 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:04.081602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:04.081907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46bee14-ec9d-4989-9eac-2d1da83af34f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:04.082882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:04.094956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:04.095625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:04.096265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:04.096561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] PATH_INFO: `/v3/users/31275d6f3a814d02ac1d9a77fea964a8` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:04.097797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] RBAC: Authorizing `identity:delete_user(user_id=31275d6f3a814d02ac1d9a77fea964a8)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:04.100413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:04.110764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35f3b1-394b-4d14-a4c5-791eaf26f5ef service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:04.124627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:04.128039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:04.128627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:04.131013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] PATH_INFO: `/v3/projects/eb63e6e85ce54122aa1594a898719a08` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:04.135643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb63e6e85ce54122aa1594a898719a08)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:04.141371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:04.206879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31275d6f3a814d02ac1d9a77fea964a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.207722 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31275d6f3a814d02ac1d9a77fea964a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.208461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31275d6f3a814d02ac1d9a77fea964a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.225603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31275d6f3a814d02ac1d9a77fea964a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.252852 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8b1b9073-d6d8-4cf1-b6cd-fe6984e8a6df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31275d6f3a814d02ac1d9a77fea964a8'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.263413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb63e6e85ce54122aa1594a898719a08', 'request_id': 'req-879e5e69-f899-4464-b251-ff4d8f642e26'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.273592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb63e6e85ce54122aa1594a898719a08', 'request_id': 'req-879e5e69-f899-4464-b251-ff4d8f642e26'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.278973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1277/2588] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:04 2022] DELETE /identity/v3/users/31275d6f3a814d02ac1d9a77fea964a8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:04.281276 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:04.281615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:04.281891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:04.293052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb63e6e85ce54122aa1594a898719a08', 'request_id': 'req-879e5e69-f899-4464-b251-ff4d8f642e26'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.298754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:04.317764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:04.318961 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] The token cache is being invalidate because project eb63e6e85ce54122aa1594a898719a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:04.319740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.321131 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.323629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1312/2589] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:04 2022] DELETE /identity/v3/projects/eb63e6e85ce54122aa1594a898719a08 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:04.326713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:04.327742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:04.329797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:04.331814 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:04.416369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1278/2590] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:04.424909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:04.426447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5e69-f899-4464-b251-ff4d8f642e26 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:04.427403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:04.433873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:04.434534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:04.434820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:04.435078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] PATH_INFO: `/v3/users/7b2eb01dc6344a88bebebe951f05c9ea` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:04.436388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2eb01dc6344a88bebebe951f05c9ea)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:04.438365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:04.506554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2eb01dc6344a88bebebe951f05c9ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.507644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2eb01dc6344a88bebebe951f05c9ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.508898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2eb01dc6344a88bebebe951f05c9ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.517252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02881f-8682-44f8-a6cf-fb2b7e6b1080 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:04.520633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2eb01dc6344a88bebebe951f05c9ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.521684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:04.522477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:04.522806 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:04.523158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:04.526400 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:04.537999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2eb01dc6344a88bebebe951f05c9ea'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:04.542834 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:04.545078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:04.561056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1313/2591] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:04 2022] DELETE /identity/v3/users/7b2eb01dc6344a88bebebe951f05c9ea => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:04.565140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1279/2592] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:05.153338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:05.155955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:05.179734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:05.182840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:05.214996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15300af-31a1-45d8-8378-79a1ec3e1e93 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:05.312748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:05.313775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.314469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.316359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] PATH_INFO: `/v3/projects/a47927d7b5c04dbcaa913d323e1556ce` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.319237 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47927d7b5c04dbcaa913d323e1556ce)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:05.323466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:05.334419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a0223-9c9f-4a85-80ef-65f6968fc461 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:05.341812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:05.342742 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.343172 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.343453 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] PATH_INFO: `/v3/projects/4c6c756a4e204c77a766940f85aba4d9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.345215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6c756a4e204c77a766940f85aba4d9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:05.347847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:05.374167 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:05.409232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47927d7b5c04dbcaa913d323e1556ce', 'request_id': 'req-60748249-5f08-4d78-b000-eeef381b752c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.417084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47927d7b5c04dbcaa913d323e1556ce', 'request_id': 'req-60748249-5f08-4d78-b000-eeef381b752c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.420725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:05.429421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47927d7b5c04dbcaa913d323e1556ce', 'request_id': 'req-60748249-5f08-4d78-b000-eeef381b752c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.435297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6c756a4e204c77a766940f85aba4d9', 'request_id': 'req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.445773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6c756a4e204c77a766940f85aba4d9', 'request_id': 'req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.445994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] The token cache is being invalidate because project a47927d7b5c04dbcaa913d323e1556ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:05.446099 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.447399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.449375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1280/2593] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:05 2022] DELETE /identity/v3/projects/a47927d7b5c04dbcaa913d323e1556ce => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:05.455829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:05.458956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:05.460828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6c756a4e204c77a766940f85aba4d9', 'request_id': 'req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.480505 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] The token cache is being invalidate because project 4c6c756a4e204c77a766940f85aba4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:05.481357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.483166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-d2f9f2a2-35d1-470b-ae34-f4a6464fb95f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.486680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1314/2594] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:05 2022] DELETE /identity/v3/projects/4c6c756a4e204c77a766940f85aba4d9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:05.491981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaec59-b9b7-4560-9061-efd8435448be None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.495135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaec59-b9b7-4560-9061-efd8435448be None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.495905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfaec59-b9b7-4560-9061-efd8435448be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.533747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8bfaec59-b9b7-4560-9061-efd8435448be None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:05.535173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8bfaec59-b9b7-4560-9061-efd8435448be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:05.569497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60748249-5f08-4d78-b000-eeef381b752c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:05.636073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1315/2595] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:05.639541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d15d17-d247-4802-a4db-1636b792b102 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.640049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d15d17-d247-4802-a4db-1636b792b102 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.640338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d15d17-d247-4802-a4db-1636b792b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.667277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:05.667944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.668266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.668536 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] PATH_INFO: `/v3/users/603af6df94b0470d9dd1bdc8291fb248` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.669276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d4d15d17-d247-4802-a4db-1636b792b102 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:05.669696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=603af6df94b0470d9dd1bdc8291fb248)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:05.670637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d4d15d17-d247-4802-a4db-1636b792b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:05.671710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:05.683009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1316/2596] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:05.687242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d15d17-d247-4802-a4db-1636b792b102 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:05.697471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d15d17-d247-4802-a4db-1636b792b102 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:05.702960 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:05.703229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.703476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.703751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.704487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:05.704787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:05.706654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:05.723494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1317/2597] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:05.729026 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:05.744669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39e36c-15c4-44a5-b569-86b16a6dc20d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:05.759206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603af6df94b0470d9dd1bdc8291fb248'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.759986 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603af6df94b0470d9dd1bdc8291fb248'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.760786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603af6df94b0470d9dd1bdc8291fb248'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.761011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:05.761668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.762001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.762211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.762887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:05.765071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:05.770025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603af6df94b0470d9dd1bdc8291fb248'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.786895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603af6df94b0470d9dd1bdc8291fb248'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:05.804381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1281/2598] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:05 2022] DELETE /identity/v3/users/603af6df94b0470d9dd1bdc8291fb248 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:05.804617 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1318/2599] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:05 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:05.809044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:05.810553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:05.827381 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:05.915890 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688531f0-460b-41f8-b92d-bf22f246ea54 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:05.925125 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:05.926461 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:05.926756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:05.927056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:05.927744 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:05.931445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:05.965457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1282/2600] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:05 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:05.968475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.097123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a9ce22-bf8d-4ca0-8dbd-63e0defc3d89 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.120244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.121137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.121522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.122187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.123031 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.125175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.137273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:06.144894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1319/2601] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:06.149038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.170296 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3475eef-815f-4c82-a03a-269793cccb6f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.178131 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.179241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.179241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.179454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.179962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.182570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.198416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1283/2602] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:06.200459 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.220158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786b879-d5d9-4c9a-80d3-7ea84779eec0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.230503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fcd71-1530-47f0-83dd-27e5768b4ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.232082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fcd71-1530-47f0-83dd-27e5768b4ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.232541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fcd71-1530-47f0-83dd-27e5768b4ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.233285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fcd71-1530-47f0-83dd-27e5768b4ae4 admin admin] PATH_INFO: `/v3/projects/f623f5639bf54e999c663ac8e81cd9fa/users/1f75afc895924e419f36352c9bec8490/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.261443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.264143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.271548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fcd71-1530-47f0-83dd-27e5768b4ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f623f5639bf54e999c663ac8e81cd9fa, user_id=1f75afc895924e419f36352c9bec8490, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.287005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fcd71-1530-47f0-83dd-27e5768b4ae4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.289414 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80867d37-fb40-4928-ad60-950c830b635f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.297600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.298192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.298502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.298757 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] PATH_INFO: `/v3/projects/27d587b3e9d943c09c16a0d5ad5f73e6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.300249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d587b3e9d943c09c16a0d5ad5f73e6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.302416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.307548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1320/2603] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:06 2022] PUT /identity/v3/projects/f623f5639bf54e999c663ac8e81cd9fa/users/1f75afc895924e419f36352c9bec8490/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:06.319312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.319605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.319843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.365456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] MFA Rules not processed for user `1f75afc895924e419f36352c9bec8490`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:06.366855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.367385 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d587b3e9d943c09c16a0d5ad5f73e6', 'request_id': 'req-cc5f1d4c-8cad-4152-b792-ce5c88620540'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.376732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d587b3e9d943c09c16a0d5ad5f73e6', 'request_id': 'req-cc5f1d4c-8cad-4152-b792-ce5c88620540'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.385495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d587b3e9d943c09c16a0d5ad5f73e6', 'request_id': 'req-cc5f1d4c-8cad-4152-b792-ce5c88620540'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.401558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] The token cache is being invalidate because project 27d587b3e9d943c09c16a0d5ad5f73e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:06.401907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.402558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cc5f1d4c-8cad-4152-b792-ce5c88620540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.405775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1284/2604] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:06 2022] DELETE /identity/v3/projects/27d587b3e9d943c09c16a0d5ad5f73e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:06.412219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e8f71-7f87-4ed7-8d82-23f7336f44ca None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.412498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e8f71-7f87-4ed7-8d82-23f7336f44ca None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.412930 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e8f71-7f87-4ed7-8d82-23f7336f44ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.436532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8e4e8f71-7f87-4ed7-8d82-23f7336f44ca None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:06.437829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8e4e8f71-7f87-4ed7-8d82-23f7336f44ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.460165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1321/2605] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:06.481878 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.483938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.511939 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1285/2606] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:06.524370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc55f-33ab-44a8-af6d-34110ab6deaa None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.525632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc55f-33ab-44a8-af6d-34110ab6deaa None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.525914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fc55f-33ab-44a8-af6d-34110ab6deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.548431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8a7fc55f-33ab-44a8-af6d-34110ab6deaa None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:06.549671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8a7fc55f-33ab-44a8-af6d-34110ab6deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.552311 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702bbfa-60b4-439d-82fe-60e8dc52093f None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.555930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.556674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.556957 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.557227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.558530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1286/2607] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:06.562874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc55f-33ab-44a8-af6d-34110ab6deaa None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.567355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.568683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:06.568867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.575511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fc55f-33ab-44a8-af6d-34110ab6deaa None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.580134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1322/2608] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:06.583622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.584346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.585031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.585415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.586087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:06.586692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.589649 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.604190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1287/2609] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:08:06.604590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.609088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.611219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.626587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1708ad6f-a5b8-4f97-a59b-8088d29f05c9 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.631034 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca363-2a13-4bc5-adcd-42de9aa8ac66 service cinder] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.632289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.632911 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.633186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.633454 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.635688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.637513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.637876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.638001 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.638240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.638534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] PATH_INFO: `/v3/users/1f75afc895924e419f36352c9bec8490` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.639831 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f75afc895924e419f36352c9bec8490)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.641794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.672953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1288/2610] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:06 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:06.677060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.716189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f75afc895924e419f36352c9bec8490'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.716189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f75afc895924e419f36352c9bec8490'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.716189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f75afc895924e419f36352c9bec8490'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.723405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f75afc895924e419f36352c9bec8490'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.729875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:06.742102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-4a64f416-19b1-4cb0-8e78-b995e523fbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f75afc895924e419f36352c9bec8490'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:06.759208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c2cd-bd43-4040-9afa-086423793276 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.764778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.765179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.765459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.765741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.766377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.768513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.777690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1323/2611] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:06 2022] DELETE /identity/v3/users/1f75afc895924e419f36352c9bec8490 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:06.782865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.783155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.783437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.791647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1289/2612] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:06 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:08:06.796051 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.797812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.805529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:06.807244 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.811378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071cca9-0227-47b7-b073-bc8057ea806f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.891937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.892695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.892976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.893310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.894183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.895924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.907460 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1324/2613] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:06.913654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1290/2614] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:08:06.918329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.918842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.920934 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:06.936845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f9d9d-a04b-40b5-8543-f1ebd16f2e07 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.942177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.942855 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.943168 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.943498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:06.945643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:06.945820 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:06.957116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1291/2615] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:06.963488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:06.981067 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be0489-88d2-4489-9f69-9e9a3b81afd6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:06.988439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c6129-500f-44dc-9574-e5b98d9c9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:06.990494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6129-500f-44dc-9574-e5b98d9c9922 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:06.990494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6129-500f-44dc-9574-e5b98d9c9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:06.990494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c6129-500f-44dc-9574-e5b98d9c9922 admin admin] PATH_INFO: `/v3/projects/7a756123355342f68387459984c48bef/users/d5bf7c4cfb8a405797810b93ed73b62c/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.013001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c6129-500f-44dc-9574-e5b98d9c9922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a756123355342f68387459984c48bef, user_id=d5bf7c4cfb8a405797810b93ed73b62c, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.015961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c6129-500f-44dc-9574-e5b98d9c9922 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.026250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223f113-1558-48c3-99dd-09698560a6b5 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.034176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1292/2616] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:06 2022] PUT /identity/v3/projects/7a756123355342f68387459984c48bef/users/d5bf7c4cfb8a405797810b93ed73b62c/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:07.045653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af0bb-27b6-4e68-85de-54642f4d7439 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.045976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af0bb-27b6-4e68-85de-54642f4d7439 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.046221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af0bb-27b6-4e68-85de-54642f4d7439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.092898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.093900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.094264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.094545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.094696 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-116af0bb-27b6-4e68-85de-54642f4d7439 None None] MFA Rules not processed for user `d5bf7c4cfb8a405797810b93ed73b62c`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:07.096413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-116af0bb-27b6-4e68-85de-54642f4d7439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:07.125014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:07.204085 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:07.215661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1293/2617] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:07.220616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af0bb-27b6-4e68-85de-54642f4d7439 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.230153 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.231759 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.239962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af0bb-27b6-4e68-85de-54642f4d7439 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.246425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.247055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.247356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.247849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.248875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.249223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1325/2618] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:07.250710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.293647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1294/2619] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:07 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:08:07.298848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.312440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c57c1-6c1f-4a0d-bb19-7052a40d797b service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.398422 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.399082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.399426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.401877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.401877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.403339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.430444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1326/2620] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:07 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:07.436572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.449622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf970b-410c-4705-bb67-1aca01bc53c7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.454949 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.455631 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.455924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.456225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.456879 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.458694 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.470269 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1295/2621] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:07.476571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.489119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b9881a-e26d-44fe-b5d6-fe956677012d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.494847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.495988 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.496338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.496791 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] PATH_INFO: `/v3/projects/267c4f1171c649708b50f1d530c9f266/users/0af969ed28344f85abb02d75aa5bdf6f/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.515941 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] RBAC: Authorizing `identity:create_grant(project_id=267c4f1171c649708b50f1d530c9f266, user_id=0af969ed28344f85abb02d75aa5bdf6f, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.518697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.538497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1327/2622] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:07 2022] PUT /identity/v3/projects/267c4f1171c649708b50f1d530c9f266/users/0af969ed28344f85abb02d75aa5bdf6f/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:07.544057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.556831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23c32-395e-43e9-9dc9-d27e9c9601fb admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.637064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.637710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.637990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.638267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.641244 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.641973 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.642902 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.645940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:07.659086 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1296/2623] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:07.661562 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.665540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4b37-4bf4-41c5-9272-5ddc61c4053d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.673110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.673931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.674187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.674377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5b278-232c-443e-be1a-007b1c7773b2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.674564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] PATH_INFO: `/v3/projects/f623f5639bf54e999c663ac8e81cd9fa` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.675824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f623f5639bf54e999c663ac8e81cd9fa)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.677863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.684952 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192792fb-5213-4d3d-a77a-c8c44d007a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.685745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192792fb-5213-4d3d-a77a-c8c44d007a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.686087 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192792fb-5213-4d3d-a77a-c8c44d007a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.686426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192792fb-5213-4d3d-a77a-c8c44d007a88 admin admin] PATH_INFO: `/v3/projects/267c4f1171c649708b50f1d530c9f266/users/0af969ed28344f85abb02d75aa5bdf6f/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.689093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192792fb-5213-4d3d-a77a-c8c44d007a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=267c4f1171c649708b50f1d530c9f266, user_id=0af969ed28344f85abb02d75aa5bdf6f, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.693211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192792fb-5213-4d3d-a77a-c8c44d007a88 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.707655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1297/2624] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:07 2022] PUT /identity/v3/projects/267c4f1171c649708b50f1d530c9f266/users/0af969ed28344f85abb02d75aa5bdf6f/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:07.721809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.722199 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.722577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.745140 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f623f5639bf54e999c663ac8e81cd9fa', 'request_id': 'req-e4745953-ed73-48e0-8a12-06e5103a8e05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:07.753569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f623f5639bf54e999c663ac8e81cd9fa', 'request_id': 'req-e4745953-ed73-48e0-8a12-06e5103a8e05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:07.754401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] MFA Rules not processed for user `0af969ed28344f85abb02d75aa5bdf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:07.755726 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:07.763395 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f623f5639bf54e999c663ac8e81cd9fa', 'request_id': 'req-e4745953-ed73-48e0-8a12-06e5103a8e05'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:07.776727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] The token cache is being invalidate because project f623f5639bf54e999c663ac8e81cd9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:07.777159 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:07.777696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-e4745953-ed73-48e0-8a12-06e5103a8e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:07.779446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1328/2625] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:07 2022] DELETE /identity/v3/projects/f623f5639bf54e999c663ac8e81cd9fa => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:07.784657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81c837-8fa1-4797-bd6d-fda632a93dc3 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.785017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81c837-8fa1-4797-bd6d-fda632a93dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.785287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81c837-8fa1-4797-bd6d-fda632a93dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.807885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bb81c837-8fa1-4797-bd6d-fda632a93dc3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:07.809292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bb81c837-8fa1-4797-bd6d-fda632a93dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:07.816007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:07.843754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1298/2626] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:07.846292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:07.860109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.861571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:07.890018 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1329/2627] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:07.898407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bde4a-5f70-415d-a413-5cac6c7d7595 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.898689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bde4a-5f70-415d-a413-5cac6c7d7595 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.898963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bde4a-5f70-415d-a413-5cac6c7d7595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.926202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-9c3bde4a-5f70-415d-a413-5cac6c7d7595 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:07.927886 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-9c3bde4a-5f70-415d-a413-5cac6c7d7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:07.936950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b765f-5f33-41c6-b5c5-84945535c8bb None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.937264 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1330/2628] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:07.941027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.941375 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bde4a-5f70-415d-a413-5cac6c7d7595 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:07.941645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.942031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.942302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.955102 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bde4a-5f70-415d-a413-5cac6c7d7595 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:07.956678 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.958170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.960584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:07.961203 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:07.961487 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:07.961782 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:07.962619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:07.962619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:07.964532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:07.971246 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1299/2629] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:07.981698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1331/2630] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:08:07.982931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.000192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ddd78-c1cc-4dfd-b553-27e86eb142af service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.007359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.008350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.008817 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.009286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.010362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.016474 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.061091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1300/2631] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:07 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:08.062066 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.071761 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.074981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfbc19-f6b5-4ac9-8d42-8be2c9f2b50a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.154080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad6b5f-dafe-489d-a5ae-6d67adc853ce admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.158510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.159315 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.159729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.160196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.162360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.163193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.163821 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.164126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.164405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.165064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.168061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.202526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1332/2632] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:08 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:08:08.207150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.219843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b492526-9832-41a5-9118-998523e216c4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.225633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.226464 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.226899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.227324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.228786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.230820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.254670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1333/2633] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:08.256277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.269058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d7388-4536-46c3-bb46-c4fb58cf9a9e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.270458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.272988 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.285225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.285840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.286113 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.286381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.287061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.288646 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.300150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1301/2634] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:08.301643 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.303504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.308160 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1334/2635] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:08.309370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.322425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f13eb2-438b-4a0d-be46-3f43da765f1b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.328860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.329524 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.329858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.330137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] PATH_INFO: `/v3/projects/f21a4b2327f94331beb435684af13339/users/3a7137325c6a4e0f9c7cf98b34c89f6e/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.338396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:08.355429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21a4b2327f94331beb435684af13339, user_id=3a7137325c6a4e0f9c7cf98b34c89f6e, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.359079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.378028 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1335/2636] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:08 2022] PUT /identity/v3/projects/f21a4b2327f94331beb435684af13339/users/3a7137325c6a4e0f9c7cf98b34c89f6e/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:08.378885 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.389963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.401932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a45c26-3c43-4d27-bc63-df0f2bff5302 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.472084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ed406-1a9a-45df-b0ec-033915c8bec7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.474430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b7ad-fc7f-45ff-a047-6fd0f9dea4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.475708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b7ad-fc7f-45ff-a047-6fd0f9dea4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.476252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b7ad-fc7f-45ff-a047-6fd0f9dea4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.476759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b7ad-fc7f-45ff-a047-6fd0f9dea4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.478056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.478581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.478862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.479139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] PATH_INFO: `/v3/users/883f296ed3d0423485aa4fce1f3fd9a6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.480812 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=883f296ed3d0423485aa4fce1f3fd9a6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.481397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0b17b7ad-fc7f-45ff-a047-6fd0f9dea4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.483304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.485130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:08.497266 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b7ad-fc7f-45ff-a047-6fd0f9dea4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.499840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b7ad-fc7f-45ff-a047-6fd0f9dea4f2 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.517895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1302/2637] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:08.520176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.520671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.521255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.564489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883f296ed3d0423485aa4fce1f3fd9a6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:08.567604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883f296ed3d0423485aa4fce1f3fd9a6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:08.568794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883f296ed3d0423485aa4fce1f3fd9a6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:08.573916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] MFA Rules not processed for user `3a7137325c6a4e0f9c7cf98b34c89f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:08.575572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.594936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883f296ed3d0423485aa4fce1f3fd9a6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:08.617429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-1e041bb1-4df1-4e05-be9c-7a54ae66e5fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883f296ed3d0423485aa4fce1f3fd9a6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:08.680054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1336/2638] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:08 2022] DELETE /identity/v3/users/883f296ed3d0423485aa4fce1f3fd9a6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:08.682179 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.682649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.683356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.713123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1303/2639] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:08.725708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.727457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.731048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:08.732426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.831046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cb17e-e046-462b-ba6d-b962ef675ded None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.861607 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1337/2640] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:08.862902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:08.875942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:08.878175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:08.909792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653d617-0bfe-48c7-a0a1-bfd1970693e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.910427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d617-0bfe-48c7-a0a1-bfd1970693e9 service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.910708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d617-0bfe-48c7-a0a1-bfd1970693e9 service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.911019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d617-0bfe-48c7-a0a1-bfd1970693e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.963006 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f768db5c-0b0f-4a4e-8745-d076a7f63601 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:08.967036 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:08.967672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:08.973950 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:08.974300 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:08.986048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.987491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.996439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653d617-0bfe-48c7-a0a1-bfd1970693e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:08.997983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653d617-0bfe-48c7-a0a1-bfd1970693e9 service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:08.998714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1338/2641] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:09.010465 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1304/2642] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:09.785373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:09.786966 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:09.808044 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d5306-dc2f-449b-831a-7b887d9cf12c service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:09.825992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:09.827088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:09.828561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:09.829094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] PATH_INFO: `/v3/projects/8b7ea596808f40dfb78119149607b723` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:09.830921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b7ea596808f40dfb78119149607b723)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:09.833156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:09.871233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:09.928338 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b7ea596808f40dfb78119149607b723', 'request_id': 'req-2e36fb07-db41-4701-8325-5556e1378d3a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:09.936656 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b7ea596808f40dfb78119149607b723', 'request_id': 'req-2e36fb07-db41-4701-8325-5556e1378d3a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:09.946064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b7ea596808f40dfb78119149607b723', 'request_id': 'req-2e36fb07-db41-4701-8325-5556e1378d3a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:09.971356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] The token cache is being invalidate because project 8b7ea596808f40dfb78119149607b723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:09.971555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:09.973644 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-2e36fb07-db41-4701-8325-5556e1378d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:09.976282 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1339/2643] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:09 2022] DELETE /identity/v3/projects/8b7ea596808f40dfb78119149607b723 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:09.982330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3dfe5-a7c7-4997-8766-6c62af9cc080 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:09.983095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3dfe5-a7c7-4997-8766-6c62af9cc080 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:09.983095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3dfe5-a7c7-4997-8766-6c62af9cc080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.023558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-abd3dfe5-a7c7-4997-8766-6c62af9cc080 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:10.026157 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-abd3dfe5-a7c7-4997-8766-6c62af9cc080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:10.140931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1305/2644] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:10.155870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7420-9041-4ead-86a2-3f831d305137 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.156075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7420-9041-4ead-86a2-3f831d305137 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.156972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b7420-9041-4ead-86a2-3f831d305137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.203655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-e91b7420-9041-4ead-86a2-3f831d305137 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:10.204936 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e91b7420-9041-4ead-86a2-3f831d305137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:10.217962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1340/2645] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:10.231248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3dfe5-a7c7-4997-8766-6c62af9cc080 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:10.246171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3dfe5-a7c7-4997-8766-6c62af9cc080 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:10.252771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:10.253561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.253909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.254277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.255019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:10.256830 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:10.257378 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:10.278704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1306/2646] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:10.280539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b7420-9041-4ead-86a2-3f831d305137 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:10.300471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b7420-9041-4ead-86a2-3f831d305137 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:10.310339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:10.312810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.313295 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.313775 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.314919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:10.318687 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:10.363863 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1341/2647] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:10 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:10.369526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:10.380511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19a02-5e47-40b6-8f5b-a50b06b5db68 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:10.469860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:10.470502 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.470779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.471047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.471679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:10.473672 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:10.496205 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:10.512383 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1307/2648] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:10 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:10.517465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:10.532420 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44ca39-14ec-4f06-8ab7-5736671f000d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:10.537284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:10.537922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.538183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.538457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.539114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:10.540930 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:10.559769 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1342/2649] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:10.561792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:10.572884 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebea81-01be-4bcb-8406-5dbdfa9b12e0 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:10.578629 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17281f42-a1a8-4df0-887d-526a1e13b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:10.579283 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281f42-a1a8-4df0-887d-526a1e13b0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.579568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281f42-a1a8-4df0-887d-526a1e13b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.579845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17281f42-a1a8-4df0-887d-526a1e13b0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.580552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281f42-a1a8-4df0-887d-526a1e13b0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:10.582198 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17281f42-a1a8-4df0-887d-526a1e13b0e9 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:10.595754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1308/2650] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:10.600337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:10.634218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9ade2-c3db-47e4-8116-e57521411638 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:10.645880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:10.646641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.646921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.647134 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] PATH_INFO: `/v3/projects/3b298d45e41a4a8f8f4c7385b25638d8/users/0dbee176f5c64c54a80a08f9ae48906b/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.671146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b298d45e41a4a8f8f4c7385b25638d8, user_id=0dbee176f5c64c54a80a08f9ae48906b, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:10.680701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:10.695578 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1343/2651] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:10 2022] PUT /identity/v3/projects/3b298d45e41a4a8f8f4c7385b25638d8/users/0dbee176f5c64c54a80a08f9ae48906b/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:10.701357 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.701808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.702275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.735412 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:10.736766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:10.822716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1309/2652] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:10.836123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:10.840414 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:10.932771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6e559-2a7e-4454-a114-c9c664961344 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:10.937462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:10.938106 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:10.938397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:10.938676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:10.958202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:10.959660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:10.973011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1344/2653] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:13.712568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:13.712568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:13.817674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:13.819115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:13.835621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b833d-a367-4f38-ae25-e3397e22d18f None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:13.843697 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:13.844491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:13.847181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:13.853107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:13.853654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d5a5e-d4fe-4734-a30f-ab1d8e6be804 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:13.855493 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:13.870354 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:13.871291 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:13.871423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:13.873361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:13.874042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] PATH_INFO: `/v3/users/df16e3ecae574db7a79d7a1d5b825336` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:13.890022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:13.894717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df16e3ecae574db7a79d7a1d5b825336)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:13.898653 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:13.904781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1310/2654] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:14.024531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:14.033059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df16e3ecae574db7a79d7a1d5b825336'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.034077 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df16e3ecae574db7a79d7a1d5b825336'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.034942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df16e3ecae574db7a79d7a1d5b825336'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.044265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df16e3ecae574db7a79d7a1d5b825336'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.073481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df16e3ecae574db7a79d7a1d5b825336'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.113392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1345/2655] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:13 2022] DELETE /identity/v3/users/df16e3ecae574db7a79d7a1d5b825336 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:14.316353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:14.318361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:14.336322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d5e74-e8cd-483b-a7df-ae743f02b761 service placement] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:14.417361 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:14.418117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:14.418793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.419148 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.419540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] PATH_INFO: `/v3/users/d5bf7c4cfb8a405797810b93ed73b62c` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.420864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:14.421038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bf7c4cfb8a405797810b93ed73b62c)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:14.427581 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:14.450711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d89f9-f670-4238-968b-9918c974ac26 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:14.460304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:14.464994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:14.465702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.465973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.466246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] PATH_INFO: `/v3/projects/7ed2f7beca7f4456ab68ef1f53a58d67` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.467523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed2f7beca7f4456ab68ef1f53a58d67)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:14.469504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:14.514684 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bf7c4cfb8a405797810b93ed73b62c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.516530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bf7c4cfb8a405797810b93ed73b62c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.517686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bf7c4cfb8a405797810b93ed73b62c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.529605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bf7c4cfb8a405797810b93ed73b62c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.554427 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9a292dc3-db00-4f00-bf19-8c933b58aa90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bf7c4cfb8a405797810b93ed73b62c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.554741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed2f7beca7f4456ab68ef1f53a58d67', 'request_id': 'req-50e58c2c-c08f-4bd2-94fe-3bba75886865'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.567462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed2f7beca7f4456ab68ef1f53a58d67', 'request_id': 'req-50e58c2c-c08f-4bd2-94fe-3bba75886865'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.581359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1311/2656] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:14 2022] DELETE /identity/v3/users/d5bf7c4cfb8a405797810b93ed73b62c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:14.585764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed2f7beca7f4456ab68ef1f53a58d67', 'request_id': 'req-50e58c2c-c08f-4bd2-94fe-3bba75886865'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.586320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.586705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.587831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.609456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] The token cache is being invalidate because project 7ed2f7beca7f4456ab68ef1f53a58d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:14.609744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.611602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-50e58c2c-c08f-4bd2-94fe-3bba75886865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:14.620081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1346/2657] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:14 2022] DELETE /identity/v3/projects/7ed2f7beca7f4456ab68ef1f53a58d67 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:14.625386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb011-0d74-4104-ac3a-015a589b8bc2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.625665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb011-0d74-4104-ac3a-015a589b8bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.625940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cb011-0d74-4104-ac3a-015a589b8bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.634603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:14.642419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:14.671362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1c8cb011-0d74-4104-ac3a-015a589b8bc2 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:14.672865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1c8cb011-0d74-4104-ac3a-015a589b8bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:14.759708 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1312/2658] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:14.769188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:14.773404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:14.799595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1347/2659] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:14.809158 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0768f-537d-49c0-a580-8a28a331a3b7 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.809523 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0768f-537d-49c0-a580-8a28a331a3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.809906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0768f-537d-49c0-a580-8a28a331a3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.850127 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8ef0768f-537d-49c0-a580-8a28a331a3b7 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:14.851686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8ef0768f-537d-49c0-a580-8a28a331a3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:14.873475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1348/2660] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:14.874926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0768f-537d-49c0-a580-8a28a331a3b7 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:14.877404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796125a1-0007-4b31-8712-e4f0035c7c78 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:14.883041 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:14.885700 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.886318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.886828 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.887816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0768f-537d-49c0-a580-8a28a331a3b7 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:14.911440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:14.915851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.916387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.916866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.918285 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:14.919926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:14.921976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:14.926428 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:14.928186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:14.940717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1313/2661] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:14.958586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1349/2662] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:08:14.962813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:14.974568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256cae4-3316-4596-87d6-a154e7377001 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:14.981392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:14.982222 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:14.982653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:14.983401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:14.983797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:14.988187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:15.059156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1314/2663] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:14 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:15.063224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:15.079181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2c3ac-d857-4111-a867-d365fc205228 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:15.134413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:15.239845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:15.240816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:15.241194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:15.241571 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:15.242800 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:15.248499 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:15.287717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1350/2664] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:15 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:15.292727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:15.307538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240a051-6cdf-45a2-a170-83e32f398664 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:15.324336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:15.325725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:15.325725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:15.325725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:15.326871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:15.329487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:15.354756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:15.366063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1315/2665] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:15.391279 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a498e7-b5d6-4fe2-8c90-096e3e89a222 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:15.415621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93a182-156a-4d11-875b-9f48ce5ae552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:15.421253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93a182-156a-4d11-875b-9f48ce5ae552 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:15.421664 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93a182-156a-4d11-875b-9f48ce5ae552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:15.422059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93a182-156a-4d11-875b-9f48ce5ae552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:15.423068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93a182-156a-4d11-875b-9f48ce5ae552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:15.425793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93a182-156a-4d11-875b-9f48ce5ae552 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:15.489387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:15.496734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1351/2666] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:08:15.513739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:15.536355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ba202-2106-4951-aede-e54e7f288094 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:15.552447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:15.554054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:15.554765 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:15.555453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] PATH_INFO: `/v3/projects/2fd48ea4ce9e4e4e90b037c01ec41bdb/users/0e0187fd93884975aea19a492b1d5ed6/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:15.612252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fd48ea4ce9e4e4e90b037c01ec41bdb, user_id=0e0187fd93884975aea19a492b1d5ed6, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:15.619329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:15.663587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1316/2667] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:15 2022] PUT /identity/v3/projects/2fd48ea4ce9e4e4e90b037c01ec41bdb/users/0e0187fd93884975aea19a492b1d5ed6/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:15.684919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:15.685449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:15.685842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:15.783100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:15.788928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:15.820907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] MFA Rules not processed for user `0e0187fd93884975aea19a492b1d5ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:15.822622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:16.038733 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1352/2668] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:16.049390 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a809a0-88b5-4f09-9e1b-9f3a70c66be6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:16.053747 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:16.057453 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:16.058352 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:16.058647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:16.058932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] PATH_INFO: `/v3/projects/7a756123355342f68387459984c48bef` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:16.060333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a756123355342f68387459984c48bef)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:16.060790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:16.063791 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:16.145704 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a756123355342f68387459984c48bef', 'request_id': 'req-297db33d-6c85-4d91-bf78-a9803913dc91'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.166379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a756123355342f68387459984c48bef', 'request_id': 'req-297db33d-6c85-4d91-bf78-a9803913dc91'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.189231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a756123355342f68387459984c48bef', 'request_id': 'req-297db33d-6c85-4d91-bf78-a9803913dc91'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.220421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] The token cache is being invalidate because project 7a756123355342f68387459984c48bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:16.220839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.229081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.231999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1317/2669] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:15 2022] DELETE /identity/v3/projects/7a756123355342f68387459984c48bef => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:16.236816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:16.239151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:16.242356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f62d83-b0cf-49c3-8c3a-480052789681 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:16.349919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:16.414958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db33d-6c85-4d91-bf78-a9803913dc91 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:16.433580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:16.434547 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:16.434958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:16.435373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] PATH_INFO: `/v3/users/0af969ed28344f85abb02d75aa5bdf6f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:16.444160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af969ed28344f85abb02d75aa5bdf6f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:16.444415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:16.444415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:16.444415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:16.444415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:16.444815 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:16.444913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:16.483341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:16.563944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af969ed28344f85abb02d75aa5bdf6f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.565328 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af969ed28344f85abb02d75aa5bdf6f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.566104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af969ed28344f85abb02d75aa5bdf6f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.566660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:16.568712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:16.578829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af969ed28344f85abb02d75aa5bdf6f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.595141 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-50d3e810-b39b-4c4a-98f9-6ffea8051f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af969ed28344f85abb02d75aa5bdf6f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:16.596068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1353/2670] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:16.618546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1318/2671] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:16 2022] DELETE /identity/v3/users/0af969ed28344f85abb02d75aa5bdf6f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:17.251225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:17.268692 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fc34d-5bfb-4f2c-b03e-a9b3835c36f7 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:17.450999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:17.451661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:17.451945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:17.455685 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] PATH_INFO: `/v3/projects/267c4f1171c649708b50f1d530c9f266` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:17.457125 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=267c4f1171c649708b50f1d530c9f266)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:17.459096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:17.583695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267c4f1171c649708b50f1d530c9f266', 'request_id': 'req-3c2836df-0422-4655-bc67-38ccdb735977'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:17.604530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267c4f1171c649708b50f1d530c9f266', 'request_id': 'req-3c2836df-0422-4655-bc67-38ccdb735977'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:17.617436 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267c4f1171c649708b50f1d530c9f266', 'request_id': 'req-3c2836df-0422-4655-bc67-38ccdb735977'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:17.623132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:17.640962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] The token cache is being invalidate because project 267c4f1171c649708b50f1d530c9f266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:17.641389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:17.643287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-3c2836df-0422-4655-bc67-38ccdb735977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:17.653518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bb015-16b2-4e26-966c-2f174179e1d4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:17.654119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bb015-16b2-4e26-966c-2f174179e1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:17.654119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bb015-16b2-4e26-966c-2f174179e1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:17.657509 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1354/2672] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:17 2022] DELETE /identity/v3/projects/267c4f1171c649708b50f1d530c9f266 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:17.679413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b78bb015-16b2-4e26-966c-2f174179e1d4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:17.682835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b78bb015-16b2-4e26-966c-2f174179e1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:17.765632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf14f24-12b3-4eb5-9fab-29ae3a47b98a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:17.766227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf14f24-12b3-4eb5-9fab-29ae3a47b98a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:17.766678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf14f24-12b3-4eb5-9fab-29ae3a47b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:17.776762 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1319/2673] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:17.802634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0cf14f24-12b3-4eb5-9fab-29ae3a47b98a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:17.804424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0cf14f24-12b3-4eb5-9fab-29ae3a47b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:17.820923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1355/2674] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:17.826213 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bb015-16b2-4e26-966c-2f174179e1d4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:17.841717 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bb015-16b2-4e26-966c-2f174179e1d4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:17.847488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:17.848160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:17.848444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:17.848716 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:17.849554 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:17.850020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:17.852170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:17.866348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1320/2675] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:17.873147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf14f24-12b3-4eb5-9fab-29ae3a47b98a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:17.886398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf14f24-12b3-4eb5-9fab-29ae3a47b98a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:17.892971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:17.893736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:17.894017 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:17.894288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:17.895054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:17.897650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:17.944445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1356/2676] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:17 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:17.948831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:17.962616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab640c9-abea-4a20-b206-917152227415 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:18.066231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:18.067278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.067736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.068259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.082530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:18.104961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:18.192155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1321/2677] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:17 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:18.193319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:18.211384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdcabf-d3d1-498c-839e-774702ff7f2d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:18.219896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:18.220734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.221089 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.221434 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.222186 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:18.224124 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:18.242768 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1357/2678] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:18.247280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:18.266206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113b8bf-d6fd-4835-90cf-b3b7f7e77861 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:18.278450 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0363c0-7f50-4ac7-b4f3-8b8924ecc11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:18.279368 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0363c0-7f50-4ac7-b4f3-8b8924ecc11e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.279758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0363c0-7f50-4ac7-b4f3-8b8924ecc11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.280048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0363c0-7f50-4ac7-b4f3-8b8924ecc11e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.280945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0363c0-7f50-4ac7-b4f3-8b8924ecc11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:18.282423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0363c0-7f50-4ac7-b4f3-8b8924ecc11e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:18.284109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:18.312543 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:18.315050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1322/2679] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:08:18.328485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6251a5-135b-4cd5-a976-b5219c53997e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:18.342292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41761558-986a-4405-ad59-e6ca67c9100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:18.342982 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761558-986a-4405-ad59-e6ca67c9100d admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.343455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761558-986a-4405-ad59-e6ca67c9100d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.343888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41761558-986a-4405-ad59-e6ca67c9100d admin admin] PATH_INFO: `/v3/projects/13c2a965615f4957a42340ecb5991a09/users/c96d159d072440cb9fa7ff9b9f9ef4bf/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.363989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761558-986a-4405-ad59-e6ca67c9100d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c2a965615f4957a42340ecb5991a09, user_id=c96d159d072440cb9fa7ff9b9f9ef4bf, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:18.366933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41761558-986a-4405-ad59-e6ca67c9100d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:18.404058 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1358/2680] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:18 2022] PUT /identity/v3/projects/13c2a965615f4957a42340ecb5991a09/users/c96d159d072440cb9fa7ff9b9f9ef4bf/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:18.482248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.482596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.482881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.532970 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.533304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.533803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.542725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] MFA Rules not processed for user `c96d159d072440cb9fa7ff9b9f9ef4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:18.543993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:18.605053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] MFA Rules not processed for user `0dbee176f5c64c54a80a08f9ae48906b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:18.606355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:18.720221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1323/2681] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:18.734429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:18.736191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:18.761219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1359/2682] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:18.765475 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:18.767734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:18.913535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564af37-7eba-49b6-89ed-b315e0028653 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:18.918999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:18.919615 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.919896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.920295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.941214 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d94204-dad1-4c89-89f1-b69368333599 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:18.947695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:18.949613 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:18.950084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:18.950370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:18.950639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:18.951281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:18.953840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:18.954889 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:19.002555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1324/2683] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:19.006079 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1360/2684] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:18 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:19.012480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:19.032362 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a004afb-11e9-418e-a5db-80f84948964c service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:19.200637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:19.201467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:19.201822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:19.202166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:19.203167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:19.208361 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:19.255173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1325/2685] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:19 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:19.256480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:19.264734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:19.271257 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f05a1-d331-4e4e-a6ae-049402e432d5 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:19.281206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:19.281879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:19.282108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:19.282374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:19.283038 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:19.286870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:19.300404 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1361/2686] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:19.306112 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:19.337302 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743ced1-12b9-4568-ab1e-311d94ab9e9f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:19.348596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:19.349311 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:19.349596 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:19.349869 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] PATH_INFO: `/v3/projects/475a1831d75f41dca01cb8a07cd4a7e0/users/f0ec13b9f1f840cbb40b881212f007a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:19.374211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475a1831d75f41dca01cb8a07cd4a7e0, user_id=f0ec13b9f1f840cbb40b881212f007a6, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:19.377186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:19.385020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:19.402522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1326/2687] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:19 2022] PUT /identity/v3/projects/475a1831d75f41dca01cb8a07cd4a7e0/users/f0ec13b9f1f840cbb40b881212f007a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:19.407532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:19.433406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628160d8-c7aa-4383-ab2d-831f052dc402 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:19.533806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:19.537148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:19.537435 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:19.537709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:19.538702 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:19.541721 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:19.558951 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1362/2688] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:19.560295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:19.573280 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ea50a-19b9-4e32-834d-37996a6107a3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:19.583047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f98f8d-0a65-4868-95f5-c083380419a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:19.584318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f98f8d-0a65-4868-95f5-c083380419a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:19.585143 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f98f8d-0a65-4868-95f5-c083380419a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:19.585921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f98f8d-0a65-4868-95f5-c083380419a5 admin admin] PATH_INFO: `/v3/projects/475a1831d75f41dca01cb8a07cd4a7e0/users/f0ec13b9f1f840cbb40b881212f007a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:19.590429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f98f8d-0a65-4868-95f5-c083380419a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=475a1831d75f41dca01cb8a07cd4a7e0, user_id=f0ec13b9f1f840cbb40b881212f007a6, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:19.594272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f98f8d-0a65-4868-95f5-c083380419a5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:19.614853 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1327/2689] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:19 2022] PUT /identity/v3/projects/475a1831d75f41dca01cb8a07cd4a7e0/users/f0ec13b9f1f840cbb40b881212f007a6/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:23.285676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:23.287807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:23.310919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041114b3-2b80-4282-b228-d4658c70843e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:23.585877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:23.588576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:23.591309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:23.592110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] PATH_INFO: `/v3/users/0e0187fd93884975aea19a492b1d5ed6` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:23.596696 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0187fd93884975aea19a492b1d5ed6)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:23.606248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:23.797630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0187fd93884975aea19a492b1d5ed6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:23.803407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0187fd93884975aea19a492b1d5ed6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:23.804980 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0187fd93884975aea19a492b1d5ed6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:23.861339 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0187fd93884975aea19a492b1d5ed6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:23.893385 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0187fd93884975aea19a492b1d5ed6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:23.923384 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1363/2690] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:23 2022] DELETE /identity/v3/users/0e0187fd93884975aea19a492b1d5ed6 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:23.930093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:23.930601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:23.931026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:24.014645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:24.016965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:24.219854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1328/2691] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:24.233218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:24.234940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:24.264895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:24.406844 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a312ac6-ec1d-41a1-9cad-151a17773a77 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:24.417035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0362a8-da5e-4807-8fd9-9582581c84ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:24.417923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0362a8-da5e-4807-8fd9-9582581c84ed service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:24.418193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0362a8-da5e-4807-8fd9-9582581c84ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:24.418648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0362a8-da5e-4807-8fd9-9582581c84ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:24.445117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0362a8-da5e-4807-8fd9-9582581c84ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:24.447088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0362a8-da5e-4807-8fd9-9582581c84ed service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:24.473755 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1364/2692] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:25.185457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:25.187128 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:25.219470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65f37b-713d-4d97-bb28-2a722d5d3dca None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:25.244799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:25.248993 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:25.249460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:25.249826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] PATH_INFO: `/v3/users/3a7137325c6a4e0f9c7cf98b34c89f6e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:25.252936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7137325c6a4e0f9c7cf98b34c89f6e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:25.270258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:25.394188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7137325c6a4e0f9c7cf98b34c89f6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:25.399626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7137325c6a4e0f9c7cf98b34c89f6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:25.404840 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7137325c6a4e0f9c7cf98b34c89f6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:25.428808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7137325c6a4e0f9c7cf98b34c89f6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:25.465801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7137325c6a4e0f9c7cf98b34c89f6e'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:25.497706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1329/2693] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:25 2022] DELETE /identity/v3/users/3a7137325c6a4e0f9c7cf98b34c89f6e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:25.504193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:25.504873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:25.505556 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:25.512739 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:25.516486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:25.639810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:25.641319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:25.848484 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1365/2694] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:25.858181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:25.862374 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:25.864327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:25.902782 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce67fec-170f-4f4a-87eb-745569c1dfe1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:25.923153 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:25.924380 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:25.926268 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:25.928426 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] PATH_INFO: `/v3/projects/2fd48ea4ce9e4e4e90b037c01ec41bdb` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:25.932842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fd48ea4ce9e4e4e90b037c01ec41bdb)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:25.937217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:26.071664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd48ea4ce9e4e4e90b037c01ec41bdb', 'request_id': 'req-cf373129-57c2-4fab-a9a8-16c0cf9303dc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.094292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb4208-1be2-4e4b-a8ff-1e32de678fcc None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:26.103913 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd48ea4ce9e4e4e90b037c01ec41bdb', 'request_id': 'req-cf373129-57c2-4fab-a9a8-16c0cf9303dc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.121617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd48ea4ce9e4e4e90b037c01ec41bdb', 'request_id': 'req-cf373129-57c2-4fab-a9a8-16c0cf9303dc'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.151552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] The token cache is being invalidate because project 2fd48ea4ce9e4e4e90b037c01ec41bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:26.152202 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.155392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.162594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1330/2695] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:25 2022] DELETE /identity/v3/projects/2fd48ea4ce9e4e4e90b037c01ec41bdb => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:26.162594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:26.168090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:26.203757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a572406-f862-489c-921b-d4fad5fb32a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:26.205274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a572406-f862-489c-921b-d4fad5fb32a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:26.206371 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a572406-f862-489c-921b-d4fad5fb32a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:26.207086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a572406-f862-489c-921b-d4fad5fb32a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:26.210626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4a572406-f862-489c-921b-d4fad5fb32a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:26.312139 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:26.357234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf373129-57c2-4fab-a9a8-16c0cf9303dc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:26.365132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:26.366379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:26.366883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:26.367480 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] PATH_INFO: `/v3/users/c96d159d072440cb9fa7ff9b9f9ef4bf` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:26.371030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96d159d072440cb9fa7ff9b9f9ef4bf)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:26.374375 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:26.421946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a572406-f862-489c-921b-d4fad5fb32a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:26.424277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a572406-f862-489c-921b-d4fad5fb32a0 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:26.457773 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1366/2696] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:26.463059 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195681f9-7d36-4052-aaa2-daff0258a630 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:26.465566 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195681f9-7d36-4052-aaa2-daff0258a630 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:26.465879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195681f9-7d36-4052-aaa2-daff0258a630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:26.481892 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96d159d072440cb9fa7ff9b9f9ef4bf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.484389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96d159d072440cb9fa7ff9b9f9ef4bf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.484389 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96d159d072440cb9fa7ff9b9f9ef4bf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.502687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96d159d072440cb9fa7ff9b9f9ef4bf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.512849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-195681f9-7d36-4052-aaa2-daff0258a630 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:26.515790 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-195681f9-7d36-4052-aaa2-daff0258a630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:26.535358 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-02c736e3-db0f-4850-b505-2aab5268f6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96d159d072440cb9fa7ff9b9f9ef4bf'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:26.541379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1367/2697] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:26.552321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36501ad-db91-4e08-8192-fbfe175b5131 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:26.553019 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36501ad-db91-4e08-8192-fbfe175b5131 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:26.553810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36501ad-db91-4e08-8192-fbfe175b5131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:26.564540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1331/2698] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:26 2022] DELETE /identity/v3/users/c96d159d072440cb9fa7ff9b9f9ef4bf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:26.566156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:26.566494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:26.566775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:26.587541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:26.597927 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a36501ad-db91-4e08-8192-fbfe175b5131 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:26.600771 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a36501ad-db91-4e08-8192-fbfe175b5131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:26.617478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:26.619329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:26.749109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1368/2699] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:26.754075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36501ad-db91-4e08-8192-fbfe175b5131 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:26.777210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1332/2700] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:26.781594 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36501ad-db91-4e08-8192-fbfe175b5131 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:26.795333 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:26.796583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:26.797110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:26.797389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:26.798342 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:26.798466 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:26.801114 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:26.821621 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1369/2701] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:26.826585 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:26.827214 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:26.839164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:26.875978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57395ca3-3d6d-4f08-94f5-4485d43f04c7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:26.886343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:26.888497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:26.890919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:26.891349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:26.893437 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:26.897693 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:26.981946 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1370/2702] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:26 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:26.984851 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:27.027285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f817c3-5e32-490a-990e-3db3fe42375a None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:27.157255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:27.158233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.158690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.159569 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.227749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c0f0-e52f-4d2b-8610-9251fcb53e6d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:27.237540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500a1cc-93aa-4465-9c05-98d934ca6729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:27.238615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a1cc-93aa-4465-9c05-98d934ca6729 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.239157 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a1cc-93aa-4465-9c05-98d934ca6729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.239984 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500a1cc-93aa-4465-9c05-98d934ca6729 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.241343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500a1cc-93aa-4465-9c05-98d934ca6729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:27.247314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500a1cc-93aa-4465-9c05-98d934ca6729 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:27.284680 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1371/2703] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:26 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:27.287744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f796-26aa-4854-a831-807a6ac9ef7e None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.288444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f796-26aa-4854-a831-807a6ac9ef7e None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.289105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f796-26aa-4854-a831-807a6ac9ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.307357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:27.315677 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:27.317981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:27.327998 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-8a31f796-26aa-4854-a831-807a6ac9ef7e None None] MFA Rules not processed for user `f0ec13b9f1f840cbb40b881212f007a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:27.329399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-8a31f796-26aa-4854-a831-807a6ac9ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:27.337031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1333/2704] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:27.338606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:27.340559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:27.360751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a407ce-8e83-4b34-a9b7-67fdb89be7b3 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:27.372162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:27.374194 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.375156 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.376208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] PATH_INFO: `/v3/projects/f21a4b2327f94331beb435684af13339` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.379139 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21a4b2327f94331beb435684af13339)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:27.384780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:27.389590 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:27.475008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1372/2705] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:27.477674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f796-26aa-4854-a831-807a6ac9ef7e None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:27.497598 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21a4b2327f94331beb435684af13339', 'request_id': 'req-e0465dfd-57cf-4452-8975-bd78447d6811'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:27.502232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f796-26aa-4854-a831-807a6ac9ef7e None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:27.510476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21a4b2327f94331beb435684af13339', 'request_id': 'req-e0465dfd-57cf-4452-8975-bd78447d6811'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:27.523326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21a4b2327f94331beb435684af13339', 'request_id': 'req-e0465dfd-57cf-4452-8975-bd78447d6811'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:27.541813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] The token cache is being invalidate because project f21a4b2327f94331beb435684af13339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:27.543082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:27.543878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:27.545759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1334/2706] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:27 2022] DELETE /identity/v3/projects/f21a4b2327f94331beb435684af13339 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:27.546439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:27.547928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:27.621587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db8830d-22db-4884-846a-dd1b3c164c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:27.622215 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8830d-22db-4884-846a-dd1b3c164c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.622497 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8830d-22db-4884-846a-dd1b3c164c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.622777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db8830d-22db-4884-846a-dd1b3c164c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.623550 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8830d-22db-4884-846a-dd1b3c164c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:27.625655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db8830d-22db-4884-846a-dd1b3c164c3b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:27.645639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1373/2707] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:27.652605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.652871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.653190 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.671210 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0465dfd-57cf-4452-8975-bd78447d6811 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:27.675447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:27.676373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.677123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.677272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.679746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:27.683360 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:27.684725 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:27.694232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1374/2708] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:27.695252 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:27.697992 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:27.715358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94ced4-5c12-4fc6-beec-573a2c3c8053 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:27.723921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dec738-f86b-4aca-9840-46ad344a5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:27.725417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec738-f86b-4aca-9840-46ad344a5b0c admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.725996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec738-f86b-4aca-9840-46ad344a5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.726428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec738-f86b-4aca-9840-46ad344a5b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.728219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec738-f86b-4aca-9840-46ad344a5b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:27.730281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec738-f86b-4aca-9840-46ad344a5b0c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:27.744793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1375/2709] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:27.747632 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef308-6a20-4af5-a813-f7051aad1b20 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.748893 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef308-6a20-4af5-a813-f7051aad1b20 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.749346 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef308-6a20-4af5-a813-f7051aad1b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.806908 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-6e9ef308-6a20-4af5-a813-f7051aad1b20 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:27.810050 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-6e9ef308-6a20-4af5-a813-f7051aad1b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:27.828978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1376/2710] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:27.830222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ef308-6a20-4af5-a813-f7051aad1b20 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:27.846907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ef308-6a20-4af5-a813-f7051aad1b20 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:27.858449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:27.860949 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:27.861397 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:27.861670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] PATH_INFO: `/v3/projects/c81e96739e52428782cbaef21f70bf4e/users/f80dd2d474b44f5394a90381e5f301e3/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:27.897137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81e96739e52428782cbaef21f70bf4e, user_id=f80dd2d474b44f5394a90381e5f301e3, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:27.897137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:27.929574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1377/2711] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:27 2022] PUT /identity/v3/projects/c81e96739e52428782cbaef21f70bf4e/users/f80dd2d474b44f5394a90381e5f301e3/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:27.929574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:27.986762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:27.996628 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:27.998812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.014356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1335/2712] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:28.015764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.018588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.022910 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf605056-cbd3-4983-8906-91732db023f3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.029138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcf6ba-e819-407d-8a4f-cd366ab988cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.030108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcf6ba-e819-407d-8a4f-cd366ab988cc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.030588 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcf6ba-e819-407d-8a4f-cd366ab988cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.031052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcf6ba-e819-407d-8a4f-cd366ab988cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.032569 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcf6ba-e819-407d-8a4f-cd366ab988cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:28.033078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcf6ba-e819-407d-8a4f-cd366ab988cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.034914 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dcf6ba-e819-407d-8a4f-cd366ab988cc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.042252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d8f0a-90cc-4954-a6fd-1af377ea62dc service glance] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.052350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.054548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.055169 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.057025 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] PATH_INFO: `/v3/projects/13c2a965615f4957a42340ecb5991a09` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.059527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c2a965615f4957a42340ecb5991a09)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.062718 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.068676 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1378/2713] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:28.073086 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab5424-7367-47a0-82d6-56b255e4a6e4 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.073678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab5424-7367-47a0-82d6-56b255e4a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.074319 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab5424-7367-47a0-82d6-56b255e4a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.117661 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-c8ab5424-7367-47a0-82d6-56b255e4a6e4 None None] MFA Rules not processed for user `f80dd2d474b44f5394a90381e5f301e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:28.120336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c8ab5424-7367-47a0-82d6-56b255e4a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.122576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:28.131962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c2a965615f4957a42340ecb5991a09', 'request_id': 'req-94281534-25a7-4c93-9f13-7de7b9e3d1a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:28.146413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c2a965615f4957a42340ecb5991a09', 'request_id': 'req-94281534-25a7-4c93-9f13-7de7b9e3d1a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:28.159983 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c2a965615f4957a42340ecb5991a09', 'request_id': 'req-94281534-25a7-4c93-9f13-7de7b9e3d1a7'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:28.189221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] The token cache is being invalidate because project 13c2a965615f4957a42340ecb5991a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:28.189707 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:28.190790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:28.193620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1336/2714] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:28 2022] DELETE /identity/v3/projects/13c2a965615f4957a42340ecb5991a09 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:28.195154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.202291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.262076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1379/2715] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:28.264704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.265200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.265922 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.299737 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:28.301888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.319329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94281534-25a7-4c93-9f13-7de7b9e3d1a7 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.324409 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce444c8b-6897-41f6-8a02-a3f6e4d06911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.325024 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce444c8b-6897-41f6-8a02-a3f6e4d06911 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.325297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce444c8b-6897-41f6-8a02-a3f6e4d06911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.325563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce444c8b-6897-41f6-8a02-a3f6e4d06911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.326185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce444c8b-6897-41f6-8a02-a3f6e4d06911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.328123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce444c8b-6897-41f6-8a02-a3f6e4d06911 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.370186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1337/2716] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:28 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:28.371639 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605fb5-9f20-410c-a90b-b01be38a02a5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.372002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605fb5-9f20-410c-a90b-b01be38a02a5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.372417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38605fb5-9f20-410c-a90b-b01be38a02a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.402007 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-38605fb5-9f20-410c-a90b-b01be38a02a5 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:28.404411 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-38605fb5-9f20-410c-a90b-b01be38a02a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.416865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1380/2717] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:28.425345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.425345 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.477957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1338/2718] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:28.479104 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38605fb5-9f20-410c-a90b-b01be38a02a5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.557388 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:28.569063 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041912fb-74ca-4a92-b5bf-b64aa33628fa None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.596272 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38605fb5-9f20-410c-a90b-b01be38a02a5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.602065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11498746-ed96-4bc6-8735-93553609d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.603359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11498746-ed96-4bc6-8735-93553609d05d admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.603747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11498746-ed96-4bc6-8735-93553609d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.604651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11498746-ed96-4bc6-8735-93553609d05d admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.606080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11498746-ed96-4bc6-8735-93553609d05d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.608402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11498746-ed96-4bc6-8735-93553609d05d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.621688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:28.653093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1339/2719] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:28 2022] POST /identity/v3/users => generated 284 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:28.654523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.655252 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.655674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.675921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.675921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.676637 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.676802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.697234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:28.699035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.716612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1340/2720] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:28.716612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.716612 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:28.770194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.772042 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.784923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1381/2721] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:28.786175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.800304 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc893dd-1223-4d2f-a31c-af3ac089aac7 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.806711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.807787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.808445 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.809109 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.810472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.813682 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.830392 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985e83e-21e3-4c9a-887b-b05e70c58321 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.833040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1382/2722] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:28.838695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.843498 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.844729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.845277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.845816 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.850792 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529498a1-4ac4-4843-bfb9-9748d054ef9a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.857312 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.857943 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.858232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.858494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.859138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:28.859511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.861144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.862972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.865788 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.879515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1383/2723] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:28.879778 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1341/2724] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:08:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:08:28.881568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.897530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:28.908530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e881b-b58c-42f6-bec0-9bbe78e70b47 service swift] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.916091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.919079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.919715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.920658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.923072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.923274 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683474e9-6a0d-4c46-8f8c-034c15b48878 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:28.929974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.939525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:28.940505 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:28.941016 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:28.941347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:28.942425 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:28.946689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:28.989946 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1342/2725] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:29.003336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:29.022716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1384/2726] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:28 2022] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:29.025592 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4fbed-02dc-4058-a729-4a5f1cc2a9f5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:29.032357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:29.135475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f2d0b-bff4-4836-8ab9-ce31303bac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:29.136839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f2d0b-bff4-4836-8ab9-ce31303bac6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.137318 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f2d0b-bff4-4836-8ab9-ce31303bac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.137775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f2d0b-bff4-4836-8ab9-ce31303bac6c admin admin] PATH_INFO: `/v3/projects/0836ff503f04443ab10a3fc94b431fea/users/89b28fb62f99475ca3d4208ef0a2f1b1/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.172822 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:29.184088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f2d0b-bff4-4836-8ab9-ce31303bac6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0836ff503f04443ab10a3fc94b431fea, user_id=89b28fb62f99475ca3d4208ef0a2f1b1, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:29.200535 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f2d0b-bff4-4836-8ab9-ce31303bac6c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:29.216471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e802f-057a-4bad-aa87-4045365daa60 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:29.227315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:29.228580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.229088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.231166 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.232368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:29.236558 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1343/2727] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:28 2022] PUT /identity/v3/projects/0836ff503f04443ab10a3fc94b431fea/users/89b28fb62f99475ca3d4208ef0a2f1b1/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:29.238647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:29.261510 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.262082 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.263149 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.292558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1385/2728] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:29 2022] POST /identity/v3/users => generated 299 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:29.294331 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:29.306650 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd63ae-d705-4848-be74-39ae6004f290 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:29.351287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] MFA Rules not processed for user `89b28fb62f99475ca3d4208ef0a2f1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:29.353443 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:29.515909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:29.541597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:29.543119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.544405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.544405 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.545595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:29.548765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:29.620356 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1386/2729] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:29.629415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:29.678789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc6b4-e7a2-4a2b-b9e5-a83254badd28 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:29.684586 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1344/2730] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:29.695233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:29.697737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:29.710280 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:29.710933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.711246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.711568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.712603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:29.714229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:29.762542 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1387/2731] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:29.764597 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:29.797858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df9548-84f2-4b4a-bee9-47c7dafe94c0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:29.818507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a5e97-483c-4017-bd11-17a97a1b4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:29.819503 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5e97-483c-4017-bd11-17a97a1b4a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.820209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5e97-483c-4017-bd11-17a97a1b4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.820732 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a5e97-483c-4017-bd11-17a97a1b4a08 admin admin] PATH_INFO: `/v3/projects/4d1e76e2625a440a98c345ceb933250a/users/41eedeef8f074791aab6425f5e2c5898/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.852574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a5e97-483c-4017-bd11-17a97a1b4a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1e76e2625a440a98c345ceb933250a, user_id=41eedeef8f074791aab6425f5e2c5898, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:29.852826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba1a14-bbdd-482c-989b-c877d90feff7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:29.857736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a5e97-483c-4017-bd11-17a97a1b4a08 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:29.857962 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59b299d3239e4f53912477d94975d9ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:29.858899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.859424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.860001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.874526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:29.876293 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:29.878324 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1388/2732] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:29 2022] PUT /identity/v3/projects/4d1e76e2625a440a98c345ceb933250a/users/41eedeef8f074791aab6425f5e2c5898/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:29.889754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1345/2733] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:29.893877 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:29.894201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:29.895340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:29.953035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] MFA Rules not processed for user `41eedeef8f074791aab6425f5e2c5898`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:29.954364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:30.079968 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1389/2734] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:30.106030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:30.107676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:30.236896 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775d5d-9994-4aae-a79d-634e77104c48 service glance] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:30.362291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28037166-3203-4e3d-baa3-fc851423cc1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:30.363557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037166-3203-4e3d-baa3-fc851423cc1b service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:30.364218 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037166-3203-4e3d-baa3-fc851423cc1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:30.364674 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28037166-3203-4e3d-baa3-fc851423cc1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:30.403304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28037166-3203-4e3d-baa3-fc851423cc1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:30.406485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28037166-3203-4e3d-baa3-fc851423cc1b service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:30.435095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1346/2735] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:32.552326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:32.553750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:32.660446 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:32.715568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016182d1-d80e-44c6-aef3-90af71e94272 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:32.723008 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:32.723894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:32.724294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:32.724868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] PATH_INFO: `/v3/users/f80dd2d474b44f5394a90381e5f301e3` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:32.727022 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80dd2d474b44f5394a90381e5f301e3)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:32.729303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:32.919138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80dd2d474b44f5394a90381e5f301e3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:32.919848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80dd2d474b44f5394a90381e5f301e3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:32.921164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80dd2d474b44f5394a90381e5f301e3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:32.951307 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80dd2d474b44f5394a90381e5f301e3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:32.990187 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80dd2d474b44f5394a90381e5f301e3'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:33.028887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:33.029823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:33.030265 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:33.037778 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1390/2736] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:32 2022] DELETE /identity/v3/users/f80dd2d474b44f5394a90381e5f301e3 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:33.073618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:33.075014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:33.120355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:33.162548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1347/2737] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:33.174744 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:33.176801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:33.329889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67758b9c-e17c-4efb-bf18-fe793c52e481 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:33.337547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4587952-7143-403e-89a2-b631b4d99a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:33.338183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4587952-7143-403e-89a2-b631b4d99a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:33.339083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4587952-7143-403e-89a2-b631b4d99a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:33.339083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4587952-7143-403e-89a2-b631b4d99a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:33.350426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4587952-7143-403e-89a2-b631b4d99a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:33.352060 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4587952-7143-403e-89a2-b631b4d99a1f service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:33.385972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1391/2738] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:33.974382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:33.976098 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:33.999926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ab61c-468d-45b4-a8e9-9af6388b50c9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:34.018356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:34.019945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.020423 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.020854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] PATH_INFO: `/v3/projects/c81e96739e52428782cbaef21f70bf4e` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.022260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81e96739e52428782cbaef21f70bf4e)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:34.025634 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:34.129191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81e96739e52428782cbaef21f70bf4e', 'request_id': 'req-13576ad8-fd4b-4c92-bdfe-75d57f65110d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:34.139823 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81e96739e52428782cbaef21f70bf4e', 'request_id': 'req-13576ad8-fd4b-4c92-bdfe-75d57f65110d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:34.163630 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81e96739e52428782cbaef21f70bf4e', 'request_id': 'req-13576ad8-fd4b-4c92-bdfe-75d57f65110d'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:34.205337 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] The token cache is being invalidate because project c81e96739e52428782cbaef21f70bf4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:34.210622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:34.210622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-13576ad8-fd4b-4c92-bdfe-75d57f65110d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:34.210622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1348/2739] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:33 2022] DELETE /identity/v3/projects/c81e96739e52428782cbaef21f70bf4e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:34.216002 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827ae9-9f77-4c50-a4ac-87217d88f3a0 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.216564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827ae9-9f77-4c50-a4ac-87217d88f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.216564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827ae9-9f77-4c50-a4ac-87217d88f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.266665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aa827ae9-9f77-4c50-a4ac-87217d88f3a0 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:34.277808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aa827ae9-9f77-4c50-a4ac-87217d88f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:34.403088 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:34.439917 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9f521-a7e8-4af1-9cf4-f4306b5606a7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.440232 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9f521-a7e8-4af1-9cf4-f4306b5606a7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.440621 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9f521-a7e8-4af1-9cf4-f4306b5606a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.446233 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1392/2740] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:34.473488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d4e9f521-a7e8-4af1-9cf4-f4306b5606a7 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:34.474771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d4e9f521-a7e8-4af1-9cf4-f4306b5606a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:34.489477 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1349/2741] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:34.491258 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827ae9-9f77-4c50-a4ac-87217d88f3a0 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:34.506457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827ae9-9f77-4c50-a4ac-87217d88f3a0 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:34.515516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:34.516246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.516555 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.516827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.517480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:34.517882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:34.519730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:34.537919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1393/2742] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:34.539327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9f521-a7e8-4af1-9cf4-f4306b5606a7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:34.557136 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9f521-a7e8-4af1-9cf4-f4306b5606a7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:34.565923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:34.566839 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.567327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.567574 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.568346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:34.571096 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:34.653976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1350/2743] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:34 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:34.659147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:34.675070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f918922-7cdc-4c16-b161-ceefb946d27a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:34.765546 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:34.766083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.766365 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.766642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.767292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:34.769482 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:34.803883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1394/2744] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:34 2022] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:34.808836 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:34.822036 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92004c40-af89-4129-bd1c-c34dc520ff3a admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:34.829040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:34.830178 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.830623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.831161 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.831995 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:34.834162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:34.846455 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1351/2745] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:34.850850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:34.880053 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338bd9da-e16e-4bef-b8af-366bd2ac3fcc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:34.882866 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ff01-383d-49d1-9d65-e8e3c1ad1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:34.884128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ff01-383d-49d1-9d65-e8e3c1ad1316 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.884631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ff01-383d-49d1-9d65-e8e3c1ad1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.885272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ff01-383d-49d1-9d65-e8e3c1ad1316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.886410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ff01-383d-49d1-9d65-e8e3c1ad1316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:34.889730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ff01-383d-49d1-9d65-e8e3c1ad1316 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:34.920585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1395/2746] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:34.922632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:34.941561 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd685b37-91ef-4346-bcf8-1d29ca15e715 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:34.949787 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:34.950653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:34.951184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:34.951667 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] PATH_INFO: `/v3/projects/7f2bc1d5d49f43959411d735c9312064/users/33fe0933e65c400fa422ad4f4345705d/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:34.990262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2bc1d5d49f43959411d735c9312064, user_id=33fe0933e65c400fa422ad4f4345705d, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:34.993592 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:35.020164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1352/2747] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:34 2022] PUT /identity/v3/projects/7f2bc1d5d49f43959411d735c9312064/users/33fe0933e65c400fa422ad4f4345705d/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:35.032567 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f4d9-6ad5-4641-a38d-9f4908339c19 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:35.032995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f4d9-6ad5-4641-a38d-9f4908339c19 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:35.033135 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3f4d9-6ad5-4641-a38d-9f4908339c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:35.095470 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d3c3f4d9-6ad5-4641-a38d-9f4908339c19 None None] MFA Rules not processed for user `33fe0933e65c400fa422ad4f4345705d`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:35.096793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d3c3f4d9-6ad5-4641-a38d-9f4908339c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:35.211784 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1396/2748] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:35.224080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:35.228070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:35.301683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:35.341278 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62c45b-780f-46b7-8bb5-e5bf944981fc admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:35.351043 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554715c-1bc8-4720-91f0-9bebeb083666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:35.351848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554715c-1bc8-4720-91f0-9bebeb083666 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:35.352258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554715c-1bc8-4720-91f0-9bebeb083666 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:35.352600 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554715c-1bc8-4720-91f0-9bebeb083666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:35.363108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554715c-1bc8-4720-91f0-9bebeb083666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:35.364924 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554715c-1bc8-4720-91f0-9bebeb083666 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:35.411909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1353/2749] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:35.751105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3f4d9-6ad5-4641-a38d-9f4908339c19 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:35.846205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:35.876716 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3f4d9-6ad5-4641-a38d-9f4908339c19 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:35.884533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:35.885691 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:35.886181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:35.886672 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] PATH_INFO: `/v3/users/33fe0933e65c400fa422ad4f4345705d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:35.888317 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fe0933e65c400fa422ad4f4345705d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:35.890801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:35.985891 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fe0933e65c400fa422ad4f4345705d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:35.987232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fe0933e65c400fa422ad4f4345705d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:35.988614 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fe0933e65c400fa422ad4f4345705d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.001697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fe0933e65c400fa422ad4f4345705d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.021313 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fe0933e65c400fa422ad4f4345705d'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.057343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1397/2750] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:35 2022] DELETE /identity/v3/users/33fe0933e65c400fa422ad4f4345705d => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:36.061689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:36.061974 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:36.062255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:36.084419 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:36.085958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:36.210620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1354/2751] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:36.229078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:36.230855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:36.329267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192178b-6269-40d7-acbe-e8dff042541c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:36.336165 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:36.336912 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:36.337353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:36.337764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:36.358780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:36.362360 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:36.377978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1398/2752] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:36.713019 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:36.716687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:36.730935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5ee6b-5791-4eb0-81cc-9e7850e138b9 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:36.739046 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:36.740211 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:36.740929 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:36.741396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] PATH_INFO: `/v3/users/41eedeef8f074791aab6425f5e2c5898` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:36.746165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41eedeef8f074791aab6425f5e2c5898)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:36.748864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:36.822502 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:36.825520 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:36.837506 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41eedeef8f074791aab6425f5e2c5898'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.838421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41eedeef8f074791aab6425f5e2c5898'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.839117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41eedeef8f074791aab6425f5e2c5898'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.854406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87936fe1-124a-41c5-9b9f-e91ab4a70bc2 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:36.863094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41eedeef8f074791aab6425f5e2c5898'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.863802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:36.864868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:36.865316 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:36.865751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] PATH_INFO: `/v3/projects/7f2bc1d5d49f43959411d735c9312064` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:36.877905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2bc1d5d49f43959411d735c9312064)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:36.881728 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:36.913333 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-031a7aae-1157-48ab-bb39-142ed7108a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41eedeef8f074791aab6425f5e2c5898'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.939545 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1355/2753] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:36 2022] DELETE /identity/v3/users/41eedeef8f074791aab6425f5e2c5898 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:36.949305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:36.951114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:36.951483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:36.975144 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2bc1d5d49f43959411d735c9312064', 'request_id': 'req-5cbf2acb-fce4-4f35-9fd2-8737165b2532'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:36.982176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:36.983475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:36.995154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2bc1d5d49f43959411d735c9312064', 'request_id': 'req-5cbf2acb-fce4-4f35-9fd2-8737165b2532'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:37.013100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2bc1d5d49f43959411d735c9312064', 'request_id': 'req-5cbf2acb-fce4-4f35-9fd2-8737165b2532'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:37.036972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:37.063403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] The token cache is being invalidate because project 7f2bc1d5d49f43959411d735c9312064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:37.063700 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:37.064697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-5cbf2acb-fce4-4f35-9fd2-8737165b2532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:37.066764 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1399/2754] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:36 2022] DELETE /identity/v3/projects/7f2bc1d5d49f43959411d735c9312064 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:37.073471 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c0c9d-54e6-4f0f-a85e-6dd31a08db56 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.074117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c0c9d-54e6-4f0f-a85e-6dd31a08db56 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.074675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c0c9d-54e6-4f0f-a85e-6dd31a08db56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.078347 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:37.106238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1356/2755] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:37.116540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.118550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:37.124989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-be9c0c9d-54e6-4f0f-a85e-6dd31a08db56 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:37.127349 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-be9c0c9d-54e6-4f0f-a85e-6dd31a08db56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:37.140267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1400/2756] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:37.154206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3d971-e01d-48ea-8c86-693785aae6c6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.155148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3d971-e01d-48ea-8c86-693785aae6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.155900 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3d971-e01d-48ea-8c86-693785aae6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.194209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-70f3d971-e01d-48ea-8c86-693785aae6c6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:37.197793 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-70f3d971-e01d-48ea-8c86-693785aae6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:37.214254 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1401/2757] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:37.218568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3d971-e01d-48ea-8c86-693785aae6c6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.230879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3d971-e01d-48ea-8c86-693785aae6c6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:37.241774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:37.243227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.243722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.244795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.245306 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01b49c-84d1-4919-b2d3-1ab48a334fb4 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:37.246065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:37.246660 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:37.250162 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:37.250403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:37.250903 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.251249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.251647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.269748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:37.278827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1402/2758] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:08:37.281074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.282429 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:37.309873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1357/2759] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:37.323037 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702cd9c-6763-466c-83e7-6ab30d2e9c3d admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:37.333574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:37.334228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.334507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.334780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.335670 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:37.348545 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:37.411332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1403/2760] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:37 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:08:37.420553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.448996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe42c2-4ff3-422f-91c1-5a355d0ee808 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:37.583275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:37.584059 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.584457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.584885 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.586472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:37.589022 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:37.646026 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1358/2761] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:37 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:37.647479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.666164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b3179d-8db4-4e63-8ec7-9a289d4fa594 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:37.691870 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:37.692531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.692810 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.693081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.694463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:37.696276 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:37.713780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1404/2762] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:37.714996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.730421 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f079bf0-3210-4c52-a2c5-448f26a61123 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:37.735829 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67f026-e36a-42fe-8bee-243419e854b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:37.736657 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f026-e36a-42fe-8bee-243419e854b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.737044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f026-e36a-42fe-8bee-243419e854b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.737435 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67f026-e36a-42fe-8bee-243419e854b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.738216 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f026-e36a-42fe-8bee-243419e854b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:37.740543 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67f026-e36a-42fe-8bee-243419e854b1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:37.756458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1359/2763] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:37.758525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.775746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a16da-dda6-44e4-ab21-23ac0017c6cc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:37.782458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:37.783888 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.784260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.784712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] PATH_INFO: `/v3/projects/b3f027bfabdb40e8aece0ad239ea2ac9/users/d5932f5cf78e4fa983ea1cffac1f25ba/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.812294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f027bfabdb40e8aece0ad239ea2ac9, user_id=d5932f5cf78e4fa983ea1cffac1f25ba, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:37.815232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:37.845477 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1405/2764] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:37 2022] PUT /identity/v3/projects/b3f027bfabdb40e8aece0ad239ea2ac9/users/d5932f5cf78e4fa983ea1cffac1f25ba/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:37.854270 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf546d-e3fb-467c-90e5-16f564263d88 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:37.854579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf546d-e3fb-467c-90e5-16f564263d88 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:37.854864 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf546d-e3fb-467c-90e5-16f564263d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:37.878013 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:37.889584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:37.939170 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-aebf546d-e3fb-467c-90e5-16f564263d88 None None] MFA Rules not processed for user `d5932f5cf78e4fa983ea1cffac1f25ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:37.942683 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-aebf546d-e3fb-467c-90e5-16f564263d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:38.006864 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119cc46b-1a9c-4e5d-bb56-647035cfde0f admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:38.021944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:38.023156 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:38.023562 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:38.024051 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] PATH_INFO: `/v3/projects/4d1e76e2625a440a98c345ceb933250a` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:38.037202 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1e76e2625a440a98c345ceb933250a)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:38.041209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:38.095035 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1360/2765] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:38.119848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf546d-e3fb-467c-90e5-16f564263d88 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:38.125472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1e76e2625a440a98c345ceb933250a', 'request_id': 'req-c6115b8c-d12f-418c-a2c3-639cf89709a0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:38.135023 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:38.137303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1e76e2625a440a98c345ceb933250a', 'request_id': 'req-c6115b8c-d12f-418c-a2c3-639cf89709a0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:38.146887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf546d-e3fb-467c-90e5-16f564263d88 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:38.153836 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1e76e2625a440a98c345ceb933250a', 'request_id': 'req-c6115b8c-d12f-418c-a2c3-639cf89709a0'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:38.200999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] The token cache is being invalidate because project 4d1e76e2625a440a98c345ceb933250a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:38.201823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:38.203116 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:38.205837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1406/2766] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:37 2022] DELETE /identity/v3/projects/4d1e76e2625a440a98c345ceb933250a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:38.293915 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:38.294883 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:38.296459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:38.296459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:38.297699 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:38.305277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:38.377483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1361/2767] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:38 2022] POST /identity/v3/projects => generated 383 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:38.378975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:38.381712 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:38.408489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:38.417803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6115b8c-d12f-418c-a2c3-639cf89709a0 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:38.579865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:38.580493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:38.580838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:38.581119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:38.581808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:38.584325 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:38.632072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1407/2768] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:38 2022] POST /identity/v3/users => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:38.634132 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:38.655478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b14226-2e51-49ba-8bae-6f77725942e6 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:38.660458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:38.661093 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:38.661402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:38.661730 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:38.662305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:38.665146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:38.683763 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1362/2769] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:38.689493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:38.706999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf159e-3c61-4b8e-9393-a5214f4ce97a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:38.713820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:38.714882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:38.715359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:38.715641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] PATH_INFO: `/v3/projects/ddc65755e0cb4ef4893bb2dd950ac215/users/116031092182445eae04b5048703d96e/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:38.737229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc65755e0cb4ef4893bb2dd950ac215, user_id=116031092182445eae04b5048703d96e, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:38.739923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:38.767590 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1408/2770] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:38 2022] PUT /identity/v3/projects/ddc65755e0cb4ef4893bb2dd950ac215/users/116031092182445eae04b5048703d96e/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:38.769824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:38.794796 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1728034-145b-4147-aa36-a7810b872230 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:38.899563 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e0378-7114-445a-9d9c-d24266feeb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:38.900822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0378-7114-445a-9d9c-d24266feeb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:38.901209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0378-7114-445a-9d9c-d24266feeb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:38.901550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0378-7114-445a-9d9c-d24266feeb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:38.902295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e0378-7114-445a-9d9c-d24266feeb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:38.904044 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e0378-7114-445a-9d9c-d24266feeb5a admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:38.927408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1363/2771] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:38.929169 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:38.947630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6ed4b-1c3a-48e6-8252-77777a5295ee admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:38.954770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:38.955534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:38.955818 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:38.956119 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] PATH_INFO: `/v3/projects/ddc65755e0cb4ef4893bb2dd950ac215/users/116031092182445eae04b5048703d96e/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:38.958178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc65755e0cb4ef4893bb2dd950ac215, user_id=116031092182445eae04b5048703d96e, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:38.966262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:39.013884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1409/2772] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:38 2022] PUT /identity/v3/projects/ddc65755e0cb4ef4893bb2dd950ac215/users/116031092182445eae04b5048703d96e/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:39.016176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079abb89-e9ee-4647-89c8-4fa1fc09f0c5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:39.016729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079abb89-e9ee-4647-89c8-4fa1fc09f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:39.017332 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079abb89-e9ee-4647-89c8-4fa1fc09f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:39.083326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-079abb89-e9ee-4647-89c8-4fa1fc09f0c5 None None] MFA Rules not processed for user `116031092182445eae04b5048703d96e`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:39.084859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-079abb89-e9ee-4647-89c8-4fa1fc09f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:39.211655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:39.221208 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1364/2773] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:39.236631 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:39.244627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:39.367584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e78114-df5d-4f46-af3a-5962d96f63b7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:39.377848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8ad89-1af1-431d-8b82-ca61227d5c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:39.378873 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ad89-1af1-431d-8b82-ca61227d5c44 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:39.379380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ad89-1af1-431d-8b82-ca61227d5c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:39.379757 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ad89-1af1-431d-8b82-ca61227d5c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:39.393704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8ad89-1af1-431d-8b82-ca61227d5c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:39.395907 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8ad89-1af1-431d-8b82-ca61227d5c44 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:39.408805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1410/2774] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:39.575775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079abb89-e9ee-4647-89c8-4fa1fc09f0c5 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:39.587253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079abb89-e9ee-4647-89c8-4fa1fc09f0c5 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:39.592750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:39.594191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:39.594812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:39.595402 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:39.606835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:39.748130 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:39.749587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:39.763017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1365/2775] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:42.191501 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6241cd-f74c-424b-b0ae-7f798b4d55dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:42.192284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6241cd-f74c-424b-b0ae-7f798b4d55dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:42.192284 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6241cd-f74c-424b-b0ae-7f798b4d55dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:42.213194 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-1c6241cd-f74c-424b-b0ae-7f798b4d55dd None None] MFA Rules not processed for user `0dbee176f5c64c54a80a08f9ae48906b`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:42.214593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-1c6241cd-f74c-424b-b0ae-7f798b4d55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:42.287161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1411/2776] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:42.574753 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:42.576844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:42.655803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfa8d1-475c-43ea-9585-de24c590fa13 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:42.663747 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ffa6c-ad86-458f-a884-d7ba8c1bf522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:42.664594 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ffa6c-ad86-458f-a884-d7ba8c1bf522 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:42.664891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ffa6c-ad86-458f-a884-d7ba8c1bf522 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:42.665279 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ffa6c-ad86-458f-a884-d7ba8c1bf522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:42.667174 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e69ffa6c-ad86-458f-a884-d7ba8c1bf522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:42.680264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ffa6c-ad86-458f-a884-d7ba8c1bf522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:42.682014 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ffa6c-ad86-458f-a884-d7ba8c1bf522 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:42.692777 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1366/2777] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:42.775240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6241cd-f74c-424b-b0ae-7f798b4d55dd None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:42.779561 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:42.850413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6241cd-f74c-424b-b0ae-7f798b4d55dd None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:42.855845 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:42.856519 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:42.856787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:42.857057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] PATH_INFO: `/v3/users/d5932f5cf78e4fa983ea1cffac1f25ba` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:42.858236 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5932f5cf78e4fa983ea1cffac1f25ba)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:42.860381 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:42.917341 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5932f5cf78e4fa983ea1cffac1f25ba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:42.918616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5932f5cf78e4fa983ea1cffac1f25ba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:42.925917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5932f5cf78e4fa983ea1cffac1f25ba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:42.934029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5932f5cf78e4fa983ea1cffac1f25ba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:42.949598 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5932f5cf78e4fa983ea1cffac1f25ba'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:42.964678 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1412/2778] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:42 2022] DELETE /identity/v3/users/d5932f5cf78e4fa983ea1cffac1f25ba => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:42.969494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:42.969851 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:42.970192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:42.992371 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:42.993826 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:43.082405 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1367/2779] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:43.096392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:43.099585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:43.182874 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3db8a0-887a-42df-abbc-2f6ae430e98c admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:43.186740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:43.187358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:43.187630 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:43.187898 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:43.198879 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:43.200603 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:43.214770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1413/2780] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:43.553921 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:43.556661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:43.569463 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb22788-6389-4f75-bc3a-aa7dc2274c9b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:43.575231 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:43.575895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:43.576173 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:43.576446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] PATH_INFO: `/v3/projects/b3f027bfabdb40e8aece0ad239ea2ac9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:43.577647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f027bfabdb40e8aece0ad239ea2ac9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:43.579593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:43.636171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:43.650691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f027bfabdb40e8aece0ad239ea2ac9', 'request_id': 'req-784f6949-0937-454f-b7ff-e28909fd993c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.660998 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f027bfabdb40e8aece0ad239ea2ac9', 'request_id': 'req-784f6949-0937-454f-b7ff-e28909fd993c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.671017 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f027bfabdb40e8aece0ad239ea2ac9', 'request_id': 'req-784f6949-0937-454f-b7ff-e28909fd993c'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.687015 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] The token cache is being invalidate because project b3f027bfabdb40e8aece0ad239ea2ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:43.687327 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.687990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.689653 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1368/2781] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:43 2022] DELETE /identity/v3/projects/b3f027bfabdb40e8aece0ad239ea2ac9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:43.693652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:43.706659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e0fa4-c6a6-421a-a5bf-0880903fe188 service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:43.733544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:43.783766 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:43.784485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:43.784756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:43.785057 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] PATH_INFO: `/v3/users/116031092182445eae04b5048703d96e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:43.786261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=116031092182445eae04b5048703d96e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:43.788243 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:43.859064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116031092182445eae04b5048703d96e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.859971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116031092182445eae04b5048703d96e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.860945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116031092182445eae04b5048703d96e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.873234 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116031092182445eae04b5048703d96e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.892541 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-0591cb3d-3841-437d-b2c2-fd8a45695ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116031092182445eae04b5048703d96e'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:43.908786 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1414/2782] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:43 2022] DELETE /identity/v3/users/116031092182445eae04b5048703d96e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:44.262217 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:44.264880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:44.302235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f6949-0937-454f-b7ff-e28909fd993c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:44.398109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:44.398841 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.399189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.399550 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] PATH_INFO: `/v3/projects/ddc65755e0cb4ef4893bb2dd950ac215` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.401779 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc65755e0cb4ef4893bb2dd950ac215)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:44.404804 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:44.490476 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc65755e0cb4ef4893bb2dd950ac215', 'request_id': 'req-0ef8e9c6-4898-45cb-bf83-d73bfca90158'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:44.498055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc65755e0cb4ef4893bb2dd950ac215', 'request_id': 'req-0ef8e9c6-4898-45cb-bf83-d73bfca90158'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:44.509189 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc65755e0cb4ef4893bb2dd950ac215', 'request_id': 'req-0ef8e9c6-4898-45cb-bf83-d73bfca90158'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:44.526511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] The token cache is being invalidate because project ddc65755e0cb4ef4893bb2dd950ac215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:44.526944 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:44.528063 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0ef8e9c6-4898-45cb-bf83-d73bfca90158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:44.530060 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1369/2783] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:44 2022] DELETE /identity/v3/projects/ddc65755e0cb4ef4893bb2dd950ac215 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:44.535686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154298-02f2-4b6f-8669-512c61c1238b None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.537658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154298-02f2-4b6f-8669-512c61c1238b None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.538104 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02154298-02f2-4b6f-8669-512c61c1238b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.564132 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-02154298-02f2-4b6f-8669-512c61c1238b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:44.565580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-02154298-02f2-4b6f-8669-512c61c1238b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:44.667840 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1415/2784] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:44.675953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d51286-a8a4-4c83-9b30-8a0475e5786b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.676532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d51286-a8a4-4c83-9b30-8a0475e5786b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.676532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d51286-a8a4-4c83-9b30-8a0475e5786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.700504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-f9d51286-a8a4-4c83-9b30-8a0475e5786b None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:44.701745 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-f9d51286-a8a4-4c83-9b30-8a0475e5786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:44.715618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1370/2785] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:44.720619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154298-02f2-4b6f-8669-512c61c1238b None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:44.731938 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02154298-02f2-4b6f-8669-512c61c1238b None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:44.744352 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30d5ef-b778-41c2-9d1f-8013f51f7183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:44.745587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d5ef-b778-41c2-9d1f-8013f51f7183 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.746096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d5ef-b778-41c2-9d1f-8013f51f7183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.746185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30d5ef-b778-41c2-9d1f-8013f51f7183 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.747007 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30d5ef-b778-41c2-9d1f-8013f51f7183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:44.747353 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30d5ef-b778-41c2-9d1f-8013f51f7183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:44.749192 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa30d5ef-b778-41c2-9d1f-8013f51f7183 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:44.767645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1416/2786] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 14 13:08:44.776133 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d51286-a8a4-4c83-9b30-8a0475e5786b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:44.790520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d51286-a8a4-4c83-9b30-8a0475e5786b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:44.796166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:44.796777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789184-97af-4883-bb25-7705c75acca6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.796934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.797078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.797181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789184-97af-4883-bb25-7705c75acca6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.797350 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.798048 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:44.798488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63789184-97af-4883-bb25-7705c75acca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.800006 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:44.827046 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-63789184-97af-4883-bb25-7705c75acca6 None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:44.829056 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63789184-97af-4883-bb25-7705c75acca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:44.835445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1371/2787] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:44 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:44.840928 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:44.867426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:44.877664 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:44.914123 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1417/2788] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Sep 14 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:44.928910 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b9819-1183-4e19-90af-3c9dc10de2fe admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:44.934823 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789184-97af-4883-bb25-7705c75acca6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:44.936633 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63789184-97af-4883-bb25-7705c75acca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:44.937559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:44.938111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.938508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.939123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.940008 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:44.942241 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:44.971365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1372/2789] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:44 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:08:44.975647 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:44.990887 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6004e2-81f9-44bc-b204-b66a912b06d5 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:44.997016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:44.997557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:44.997858 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:44.998053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:44.999071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:45.001095 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:45.017240 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1373/2790] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:08:45.018530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:45.030648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c477c7-97bc-40d2-8c08-f2ae21f6f581 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:45.037359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:45.037997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.038540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.038725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:45.040342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:45.042066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:45.063135 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1374/2791] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:45.065229 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:45.077533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63789184-97af-4883-bb25-7705c75acca6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:45.077842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8cc7c2-2d9f-4004-b7ee-3539404a5d5c admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:45.082795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191417e-59db-4ea4-80b4-24c4ae8048c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:45.083507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191417e-59db-4ea4-80b4-24c4ae8048c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.083799 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191417e-59db-4ea4-80b4-24c4ae8048c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.084114 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191417e-59db-4ea4-80b4-24c4ae8048c4 admin admin] PATH_INFO: `/v3/projects/c3dc076966f749079a3bcf947408daf0/users/2eae62342cd14b7d83a8a3a2684e7aea/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:45.103968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191417e-59db-4ea4-80b4-24c4ae8048c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dc076966f749079a3bcf947408daf0, user_id=2eae62342cd14b7d83a8a3a2684e7aea, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:45.106976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191417e-59db-4ea4-80b4-24c4ae8048c4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:45.125531 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1375/2792] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:45 2022] PUT /identity/v3/projects/c3dc076966f749079a3bcf947408daf0/users/2eae62342cd14b7d83a8a3a2684e7aea/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:45.140567 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687414cf-8306-4519-b5cf-9bedc71a6451 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.141525 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687414cf-8306-4519-b5cf-9bedc71a6451 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.142325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687414cf-8306-4519-b5cf-9bedc71a6451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:45.201693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-687414cf-8306-4519-b5cf-9bedc71a6451 None None] MFA Rules not processed for user `2eae62342cd14b7d83a8a3a2684e7aea`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:45.205565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-687414cf-8306-4519-b5cf-9bedc71a6451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:45.212447 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:45.213189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.213719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.214065 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:45.305732 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1376/2793] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:45.310571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687414cf-8306-4519-b5cf-9bedc71a6451 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:45.337039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:45.338765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:45.363049 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1418/2794] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 14 13:08:45.434522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687414cf-8306-4519-b5cf-9bedc71a6451 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:45.439875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:45.440604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.440904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.441160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:45.441801 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:45.443770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:45.450483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:45.499797 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1377/2795] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:45 2022] POST /identity/v3/projects => generated 389 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:08:45.501585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:45.524748 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bc9eb-116a-4f35-99eb-cd09adf1c195 service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:45.574432 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:45.707087 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:45.709273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.709635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.710004 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:45.711110 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:45.714096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:45.770267 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1419/2796] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:45 2022] POST /identity/v3/users => generated 301 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:08:45.771936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:45.790845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0765a-1f65-414d-afb2-446e4b959674 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:45.797671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:45.798740 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.799310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.799880 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:45.801053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:45.805206 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:45.893926 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1378/2797] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:45.897073 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:45.920540 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3535fc3-c85d-4e0f-919d-45edad3f802e admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:45.962583 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:45.963587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:45.964558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:45.967069 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] PATH_INFO: `/v3/projects/84e89d89b06b439aa6f285e2dd23834e/users/afee2edb55a449bcbe4f77bf92738eb3/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:46.041406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e89d89b06b439aa6f285e2dd23834e, user_id=afee2edb55a449bcbe4f77bf92738eb3, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:46.053321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:46.084973 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1420/2798] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:45 2022] PUT /identity/v3/projects/84e89d89b06b439aa6f285e2dd23834e/users/afee2edb55a449bcbe4f77bf92738eb3/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:46.089685 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:46.110364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4560fa-21ae-4ccb-826b-0d018f0fe943 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:46.291650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fec36-7295-44e8-8a8e-2bd2c0e81473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:46.293808 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fec36-7295-44e8-8a8e-2bd2c0e81473 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:46.294579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fec36-7295-44e8-8a8e-2bd2c0e81473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:46.295100 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fec36-7295-44e8-8a8e-2bd2c0e81473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:46.299520 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fec36-7295-44e8-8a8e-2bd2c0e81473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:46.305264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fec36-7295-44e8-8a8e-2bd2c0e81473 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:46.365860 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1379/2799] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:46.367048 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:46.396689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51626a96-186a-49ec-8569-e25a0608b429 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:46.416148 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:46.418217 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:46.418826 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:46.419615 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] PATH_INFO: `/v3/projects/84e89d89b06b439aa6f285e2dd23834e/users/afee2edb55a449bcbe4f77bf92738eb3/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:46.423511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e89d89b06b439aa6f285e2dd23834e, user_id=afee2edb55a449bcbe4f77bf92738eb3, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:46.428195 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:46.464180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1421/2800] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:46 2022] PUT /identity/v3/projects/84e89d89b06b439aa6f285e2dd23834e/users/afee2edb55a449bcbe4f77bf92738eb3/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:46.476470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddb8df-34cb-482a-96ab-3ae2e8540e82 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:46.478843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddb8df-34cb-482a-96ab-3ae2e8540e82 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:46.480918 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddb8df-34cb-482a-96ab-3ae2e8540e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:46.577951 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-2cddb8df-34cb-482a-96ab-3ae2e8540e82 None None] MFA Rules not processed for user `afee2edb55a449bcbe4f77bf92738eb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:46.579690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-2cddb8df-34cb-482a-96ab-3ae2e8540e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:46.766267 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1380/2801] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:46.782967 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:46.785903 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:46.921713 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e88598-7a28-4392-adb0-89e84346bb26 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:46.929332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e371a3f-4a37-4413-88d0-cd208241d58f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:46.930373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371a3f-4a37-4413-88d0-cd208241d58f service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:46.931281 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371a3f-4a37-4413-88d0-cd208241d58f service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:46.931688 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371a3f-4a37-4413-88d0-cd208241d58f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:46.949895 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e371a3f-4a37-4413-88d0-cd208241d58f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:46.952574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e371a3f-4a37-4413-88d0-cd208241d58f service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:46.974763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1422/2802] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:47.359715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddb8df-34cb-482a-96ab-3ae2e8540e82 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:47.578991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:47.605287 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddb8df-34cb-482a-96ab-3ae2e8540e82 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:47.614105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:47.615031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:47.615484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:47.615916 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] PATH_INFO: `/v3/users/2eae62342cd14b7d83a8a3a2684e7aea` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:47.617990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eae62342cd14b7d83a8a3a2684e7aea)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:47.623382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:47.735953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eae62342cd14b7d83a8a3a2684e7aea'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:47.737391 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eae62342cd14b7d83a8a3a2684e7aea'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:47.738690 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eae62342cd14b7d83a8a3a2684e7aea'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:47.751768 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eae62342cd14b7d83a8a3a2684e7aea'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:47.785790 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eae62342cd14b7d83a8a3a2684e7aea'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:47.807000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1381/2803] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:47 2022] DELETE /identity/v3/users/2eae62342cd14b7d83a8a3a2684e7aea => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:47.812147 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:47.813128 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:47.813516 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:47.836639 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:47.838181 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:47.927094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1423/2804] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:08:47.939459 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:47.941812 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:48.037509 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80d232-ae79-4e7b-84a3-e9fa9c855de1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:48.043303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:48.044180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:48.044625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:48.045058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:48.060142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:48.062164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:48.076541 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1382/2805] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:48.851881 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:48.854860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:48.910889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad6cb1-081e-476a-a95f-4337a876eaad None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:48.934921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:48.936548 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:48.937040 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:48.937528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] PATH_INFO: `/v3/projects/c3dc076966f749079a3bcf947408daf0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:48.941358 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3dc076966f749079a3bcf947408daf0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:48.945232 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:49.012222 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:49.138020 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3dc076966f749079a3bcf947408daf0', 'request_id': 'req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.161189 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3dc076966f749079a3bcf947408daf0', 'request_id': 'req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.179219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3dc076966f749079a3bcf947408daf0', 'request_id': 'req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.225309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] The token cache is being invalidate because project c3dc076966f749079a3bcf947408daf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:49.225652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.226875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.229978 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1424/2806] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:48 2022] DELETE /identity/v3/projects/c3dc076966f749079a3bcf947408daf0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:49.234532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:49.248102 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9f51e-d973-47cb-b2af-5c264819f855 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:49.340516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:49.341201 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:49.341479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:49.341751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] PATH_INFO: `/v3/users/afee2edb55a449bcbe4f77bf92738eb3` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:49.342934 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afee2edb55a449bcbe4f77bf92738eb3)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:49.345314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:49.374905 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:49.417627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afee2edb55a449bcbe4f77bf92738eb3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.418356 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afee2edb55a449bcbe4f77bf92738eb3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.419111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afee2edb55a449bcbe4f77bf92738eb3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.430339 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afee2edb55a449bcbe4f77bf92738eb3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.462553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-9f4fdb31-c6fc-4b98-8c91-d976bb85d0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afee2edb55a449bcbe4f77bf92738eb3'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:49.504124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1383/2807] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:49 2022] DELETE /identity/v3/users/afee2edb55a449bcbe4f77bf92738eb3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:49.915094 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:49.916493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:49.936530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef6ccc-00f0-4cd0-ba14-8c10b62826a1 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:50.133538 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:50.134628 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.134803 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.135021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] PATH_INFO: `/v3/projects/84e89d89b06b439aa6f285e2dd23834e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.137695 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e89d89b06b439aa6f285e2dd23834e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:50.139858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:50.270574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e89d89b06b439aa6f285e2dd23834e', 'request_id': 'req-33800ced-f622-430f-a319-92cb38bd3d69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:50.283340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e89d89b06b439aa6f285e2dd23834e', 'request_id': 'req-33800ced-f622-430f-a319-92cb38bd3d69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:50.303389 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e89d89b06b439aa6f285e2dd23834e', 'request_id': 'req-33800ced-f622-430f-a319-92cb38bd3d69'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:50.320899 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] The token cache is being invalidate because project 84e89d89b06b439aa6f285e2dd23834e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:50.321379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:50.328675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-33800ced-f622-430f-a319-92cb38bd3d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:50.337762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1425/2808] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:49 2022] DELETE /identity/v3/projects/84e89d89b06b439aa6f285e2dd23834e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:50.343589 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ff75b-0013-42d8-a45f-591d998c4980 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.344359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ff75b-0013-42d8-a45f-591d998c4980 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.344359 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ff75b-0013-42d8-a45f-591d998c4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.377669 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-656ff75b-0013-42d8-a45f-591d998c4980 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:50.378904 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-656ff75b-0013-42d8-a45f-591d998c4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:50.511985 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1384/2809] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:50.521201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46abb-621f-44fd-a7d7-99c15eea16ae None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.521709 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46abb-621f-44fd-a7d7-99c15eea16ae None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.522392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46abb-621f-44fd-a7d7-99c15eea16ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.568182 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-63c46abb-621f-44fd-a7d7-99c15eea16ae None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:50.572242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-63c46abb-621f-44fd-a7d7-99c15eea16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:50.595448 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1426/2810] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:50.604483 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ff75b-0013-42d8-a45f-591d998c4980 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:50.621167 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ff75b-0013-42d8-a45f-591d998c4980 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:50.626627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:50.627780 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.628353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.628968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.630249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:50.630758 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:50.634640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:50.659679 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1385/2811] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:50.661370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46abb-621f-44fd-a7d7-99c15eea16ae None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:50.683647 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46abb-621f-44fd-a7d7-99c15eea16ae None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:50.695494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:50.696326 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.696789 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.697180 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.698029 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:50.700956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:50.748625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:50.764366 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1427/2812] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:50 2022] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:50.764637 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:50.778078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61cd14-e379-45f3-b7a1-57d962cd7161 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:50.862875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:50.863813 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.864301 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.864754 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.865577 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:50.868251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:50.894559 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1386/2813] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:50 2022] POST /identity/v3/users => generated 305 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:50.899734 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:50.911763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe9d9d-ebb4-4b2d-bb1f-03b72081d52a admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:50.917722 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:50.918485 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.918770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.919208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.919944 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:50.921839 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:50.936083 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1428/2814] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:08:50.940176 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:50.953654 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544cdeb5-c3c8-48c2-8eca-09fca086ad47 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:50.958874 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe21e4-b708-4d3d-a3f5-13eb9d87f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:50.959576 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe21e4-b708-4d3d-a3f5-13eb9d87f4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:50.959861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe21e4-b708-4d3d-a3f5-13eb9d87f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:50.960179 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe21e4-b708-4d3d-a3f5-13eb9d87f4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:50.961382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe21e4-b708-4d3d-a3f5-13eb9d87f4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:50.963171 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe21e4-b708-4d3d-a3f5-13eb9d87f4bf admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:50.982968 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1387/2815] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:50.984441 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:50.997373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd10a-c849-4250-a444-e5c5fac11e4b admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:51.002917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:51.003999 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:51.004431 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:51.004806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] PATH_INFO: `/v3/projects/330db8c01c7d459592be35c671de9f1d/users/b686365925d2413a8cd4ffd180b768b1/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:51.029322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] RBAC: Authorizing `identity:create_grant(project_id=330db8c01c7d459592be35c671de9f1d, user_id=b686365925d2413a8cd4ffd180b768b1, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:51.033271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:51.057314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1429/2816] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:50 2022] PUT /identity/v3/projects/330db8c01c7d459592be35c671de9f1d/users/b686365925d2413a8cd4ffd180b768b1/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:51.074876 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b38b-66c4-49e5-a4af-88afec8e842b None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:51.075159 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b38b-66c4-49e5-a4af-88afec8e842b None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:51.075425 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142b38b-66c4-49e5-a4af-88afec8e842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:51.083300 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:51.118759 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-4142b38b-66c4-49e5-a4af-88afec8e842b None None] MFA Rules not processed for user `b686365925d2413a8cd4ffd180b768b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:51.120088 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-4142b38b-66c4-49e5-a4af-88afec8e842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:51.227972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1388/2817] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:51.233871 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:51.387929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701114ea-c313-420d-a33a-cf79624efaff admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:51.404074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:51.404074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:51.404074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:51.404074 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:51.404625 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:51.406225 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:51.497188 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1430/2818] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:51 2022] POST /identity/v3/projects => generated 407 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:51.504335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b38b-66c4-49e5-a4af-88afec8e842b None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:51.526638 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4142b38b-66c4-49e5-a4af-88afec8e842b None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:51.697733 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:51.698367 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:51.698655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:51.698941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:51.700756 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:51.704345 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:51.753512 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1389/2819] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:51 2022] POST /identity/v3/users => generated 310 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:51.757972 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:51.771975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4d63c-36ef-46b2-8131-53c950ac2451 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:51.779462 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:51.780593 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:51.781207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:51.781671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:51.782808 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:51.785043 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:51.801802 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1431/2820] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:08:51.807871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:51.819434 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda46db-ca53-4122-afd2-efadde0533ed admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:51.825624 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:51.826261 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:51.826557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:51.826803 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] PATH_INFO: `/v3/projects/1791b565ce7e4380a238d3a40b011d8e/users/9ecbb97ea6434e669aaba53620ba4f45/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:51.855811 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1791b565ce7e4380a238d3a40b011d8e, user_id=9ecbb97ea6434e669aaba53620ba4f45, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:51.860260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:51.880068 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1390/2821] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:51 2022] PUT /identity/v3/projects/1791b565ce7e4380a238d3a40b011d8e/users/9ecbb97ea6434e669aaba53620ba4f45/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:51.884825 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:51.909415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167881b-c20d-4b03-bf6e-ceaa3f73d0f3 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:52.028536 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da88af7-fa6f-44cd-ba2d-4bc05af2b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:52.029248 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88af7-fa6f-44cd-ba2d-4bc05af2b6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:52.029444 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88af7-fa6f-44cd-ba2d-4bc05af2b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:52.029714 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88af7-fa6f-44cd-ba2d-4bc05af2b6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:52.030449 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da88af7-fa6f-44cd-ba2d-4bc05af2b6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:52.032528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da88af7-fa6f-44cd-ba2d-4bc05af2b6b6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:52.065498 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1432/2822] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:52.067109 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:52.094564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb3729-431e-42d9-a769-8fc98d832e6e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:52.117526 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:52.118274 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:52.119083 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:52.119557 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] PATH_INFO: `/v3/projects/1791b565ce7e4380a238d3a40b011d8e/users/9ecbb97ea6434e669aaba53620ba4f45/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:52.123648 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1791b565ce7e4380a238d3a40b011d8e, user_id=9ecbb97ea6434e669aaba53620ba4f45, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:52.127348 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:52.164403 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177bcb9-3395-449e-9d28-776d2de36092 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:52.164975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177bcb9-3395-449e-9d28-776d2de36092 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:52.165746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7177bcb9-3395-449e-9d28-776d2de36092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:52.168154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1391/2823] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:52 2022] PUT /identity/v3/projects/1791b565ce7e4380a238d3a40b011d8e/users/9ecbb97ea6434e669aaba53620ba4f45/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:52.215595 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-7177bcb9-3395-449e-9d28-776d2de36092 None None] MFA Rules not processed for user `9ecbb97ea6434e669aaba53620ba4f45`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:52.217011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7177bcb9-3395-449e-9d28-776d2de36092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:52.275480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:52.370795 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1433/2824] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:52 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:52.383848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:52.386992 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:52.462899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:52.479605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9076d-dfbd-43a7-9eb1-c041d56194c3 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:52.485277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:52.486314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:52.486849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:52.487317 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:52.500741 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:52.502486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:52.518650 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1392/2825] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:52 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:08:52.866399 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177bcb9-3395-449e-9d28-776d2de36092 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:52.887753 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7177bcb9-3395-449e-9d28-776d2de36092 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:52.907730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eaf34-9bd3-4b3e-b1f5-bc4a90a33cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:52.908780 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaf34-9bd3-4b3e-b1f5-bc4a90a33cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:52.909219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaf34-9bd3-4b3e-b1f5-bc4a90a33cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:52.909669 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaf34-9bd3-4b3e-b1f5-bc4a90a33cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:53.115945 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eaf34-9bd3-4b3e-b1f5-bc4a90a33cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:53.117245 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eaf34-9bd3-4b3e-b1f5-bc4a90a33cc1 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:53.142223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1434/2826] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:56.591533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:56.593052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:56.683981 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7e66b-05b4-4435-b66b-aa899f405bc4 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:56.689571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:56.690489 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:56.691225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:56.691225 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] PATH_INFO: `/v3/users/89b28fb62f99475ca3d4208ef0a2f1b1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:56.693069 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b28fb62f99475ca3d4208ef0a2f1b1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:56.695166 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:56.767713 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b28fb62f99475ca3d4208ef0a2f1b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:56.774146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b28fb62f99475ca3d4208ef0a2f1b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:56.774146 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b28fb62f99475ca3d4208ef0a2f1b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:56.778150 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b28fb62f99475ca3d4208ef0a2f1b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:56.793303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b28fb62f99475ca3d4208ef0a2f1b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:56.818527 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1393/2827] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:56 2022] DELETE /identity/v3/users/89b28fb62f99475ca3d4208ef0a2f1b1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:56.823529 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:56.824406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:56.824406 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:56.845247 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:56.846488 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:56.924763 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1435/2828] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:56.936902 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:56.938507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:57.025090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee9ab8-9e82-4060-babc-688ee8955fa2 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:57.032507 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbb22e-317d-4f16-9f9b-89900a80a6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:57.033430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb22e-317d-4f16-9f9b-89900a80a6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:57.033809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb22e-317d-4f16-9f9b-89900a80a6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:57.034181 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbb22e-317d-4f16-9f9b-89900a80a6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:57.046923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb22e-317d-4f16-9f9b-89900a80a6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:57.048751 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbb22e-317d-4f16-9f9b-89900a80a6f2 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:57.063579 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1394/2829] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:57.492155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:57.498837 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:57.520208 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d369f-c4ef-482d-a30a-ec4cea96cfc8 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:57.527843 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:57.528906 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:57.531882 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:57.533458 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] PATH_INFO: `/v3/projects/0836ff503f04443ab10a3fc94b431fea` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:57.539455 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0836ff503f04443ab10a3fc94b431fea)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:57.546601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:57.777781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0836ff503f04443ab10a3fc94b431fea', 'request_id': 'req-59cc593f-ee52-41ff-b463-8d18efc4c96b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:57.790954 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0836ff503f04443ab10a3fc94b431fea', 'request_id': 'req-59cc593f-ee52-41ff-b463-8d18efc4c96b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:57.794658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:57.806750 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0836ff503f04443ab10a3fc94b431fea', 'request_id': 'req-59cc593f-ee52-41ff-b463-8d18efc4c96b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:57.828749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] The token cache is being invalidate because project 0836ff503f04443ab10a3fc94b431fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:08:57.829719 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:57.830741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-59cc593f-ee52-41ff-b463-8d18efc4c96b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:57.833292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1436/2830] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:08:57 2022] DELETE /identity/v3/projects/0836ff503f04443ab10a3fc94b431fea => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:57.842113 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb110a-3c60-480f-b0b6-70a279bf5f99 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:57.842937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb110a-3c60-480f-b0b6-70a279bf5f99 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:57.843517 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb110a-3c60-480f-b0b6-70a279bf5f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:57.874842 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-acfb110a-3c60-480f-b0b6-70a279bf5f99 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:57.876424 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-acfb110a-3c60-480f-b0b6-70a279bf5f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:57.881659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:57.959922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1395/2831] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:57.970302 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f376-5ab1-464f-aeb1-6f02a81fda33 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:57.970525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f376-5ab1-464f-aeb1-6f02a81fda33 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:57.970758 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f376-5ab1-464f-aeb1-6f02a81fda33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:57.995314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-a1f4f376-5ab1-464f-aeb1-6f02a81fda33 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:57.996602 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a1f4f376-5ab1-464f-aeb1-6f02a81fda33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:58.005704 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1437/2832] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:58.011488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb110a-3c60-480f-b0b6-70a279bf5f99 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:58.021956 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb110a-3c60-480f-b0b6-70a279bf5f99 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:58.027943 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:58.028595 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.028875 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.029140 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.029798 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:08:58.030097 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:58.031705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:58.046922 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1396/2833] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:08:58.051791 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f376-5ab1-464f-aeb1-6f02a81fda33 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:58.061673 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f376-5ab1-464f-aeb1-6f02a81fda33 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:58.066579 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:58.067253 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.067532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.067801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.068493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:58.071336 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:58.101421 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1438/2834] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:08:58 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:58.105979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:58.116258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326da2c1-9ab7-4c61-9a61-cde36dd53c96 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:58.221089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:58.221847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.222248 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.222729 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.223568 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:58.227215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:58.312958 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1397/2835] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:08:58 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:08:58.318640 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:58.336776 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6ca9e-fbd3-4db6-bcc4-25e6b2eb48af admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:58.344552 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:58.345367 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.345746 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.346391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.347273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:58.349227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:58.364838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1439/2836] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:58.370050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:58.384255 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071d08c-837e-47ce-9a77-e65788b2a41e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:58.397119 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a38f2-58ae-4951-9017-d0c2299faae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:58.398623 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38f2-58ae-4951-9017-d0c2299faae4 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.399253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38f2-58ae-4951-9017-d0c2299faae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.399635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a38f2-58ae-4951-9017-d0c2299faae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.400868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a38f2-58ae-4951-9017-d0c2299faae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:58.403277 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a38f2-58ae-4951-9017-d0c2299faae4 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:58.425980 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1398/2837] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:08:58.427965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:58.439955 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ea8f7-3e02-443a-a8f9-644fdbf8dd66 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:58.445506 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:58.446348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.446729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.447105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] PATH_INFO: `/v3/projects/3729cbed967d4f449a60c8d38f902a91/users/2cf68ada84d14fadb218fb7603fb2fc9/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.469377 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3729cbed967d4f449a60c8d38f902a91, user_id=2cf68ada84d14fadb218fb7603fb2fc9, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:58.472468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:58.492756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1440/2838] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:08:58 2022] PUT /identity/v3/projects/3729cbed967d4f449a60c8d38f902a91/users/2cf68ada84d14fadb218fb7603fb2fc9/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:08:58.506398 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.507018 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.507571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.565397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] MFA Rules not processed for user `2cf68ada84d14fadb218fb7603fb2fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:58.566659 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:58.661822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1399/2839] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:58.675465 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:58.677260 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:58.757940 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fb2c9-775e-4343-9f86-55d4257cc177 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:58.762880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb18a7-db82-4880-be54-5111d2f3f127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:58.763563 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb18a7-db82-4880-be54-5111d2f3f127 service cinder] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:58.763855 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb18a7-db82-4880-be54-5111d2f3f127 service cinder] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:58.764155 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb18a7-db82-4880-be54-5111d2f3f127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:58.775171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb18a7-db82-4880-be54-5111d2f3f127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:58.776580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb18a7-db82-4880-be54-5111d2f3f127 service cinder] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:58.787756 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1441/2840] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:08:59.120609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:59.123342 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:59.134258 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:08:59.254603 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1217b9-a721-4eb7-876e-7aa16a0f65be None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:59.260180 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:59.260935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:59.261326 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:59.261703 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] PATH_INFO: `/v3/users/b686365925d2413a8cd4ffd180b768b1` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:59.263233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b686365925d2413a8cd4ffd180b768b1)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:59.265618 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:59.359072 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b686365925d2413a8cd4ffd180b768b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:59.361785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b686365925d2413a8cd4ffd180b768b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:59.364154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b686365925d2413a8cd4ffd180b768b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:59.391081 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b686365925d2413a8cd4ffd180b768b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:59.415445 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b686365925d2413a8cd4ffd180b768b1'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:08:59.430625 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1400/2841] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:08:59 2022] DELETE /identity/v3/users/b686365925d2413a8cd4ffd180b768b1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:08:59.437039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:59.437645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:59.438847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:59.463270 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:08:59.464601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:59.586534 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1442/2842] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:08:59.600645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:08:59.603619 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:08:59.717770 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ba3b8-407b-41f9-bd20-386b6c1c856b admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:08:59.723580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:08:59.724456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:08:59.724923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:08:59.725635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:08:59.740954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:08:59.742923 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:08:59.755404 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1401/2843] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:00.197986 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:00.218622 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:00.234974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f32f2-20a2-4e42-9549-340a859c4df9 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:00.248200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:00.248200 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:00.248654 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:00.248749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] PATH_INFO: `/v3/projects/330db8c01c7d459592be35c671de9f1d` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:00.254849 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330db8c01c7d459592be35c671de9f1d)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:00.256918 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:00.290456 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:00.326391 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330db8c01c7d459592be35c671de9f1d', 'request_id': 'req-faf44994-b70e-416b-a813-4d290233e1e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.334272 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330db8c01c7d459592be35c671de9f1d', 'request_id': 'req-faf44994-b70e-416b-a813-4d290233e1e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.352118 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330db8c01c7d459592be35c671de9f1d', 'request_id': 'req-faf44994-b70e-416b-a813-4d290233e1e4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.373322 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] The token cache is being invalidate because project 330db8c01c7d459592be35c671de9f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:00.373731 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.375150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.377064 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1443/2844] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:00 2022] DELETE /identity/v3/projects/330db8c01c7d459592be35c671de9f1d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:00.381011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:00.393494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87641e82-1b70-4de4-8a43-325356704977 service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:00.469785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:00.546061 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:00.547038 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:00.547478 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:00.548117 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] PATH_INFO: `/v3/users/9ecbb97ea6434e669aaba53620ba4f45` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:00.551126 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ecbb97ea6434e669aaba53620ba4f45)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:00.556226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:00.658123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ecbb97ea6434e669aaba53620ba4f45'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.659932 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ecbb97ea6434e669aaba53620ba4f45'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.660868 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ecbb97ea6434e669aaba53620ba4f45'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.674053 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ecbb97ea6434e669aaba53620ba4f45'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.695658 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-299c469b-5586-4f22-b38d-4cc7dbd7574c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ecbb97ea6434e669aaba53620ba4f45'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:00.722948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1402/2845] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:09:00 2022] DELETE /identity/v3/users/9ecbb97ea6434e669aaba53620ba4f45 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:01.147205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:01.149372 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:01.173698 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf44994-b70e-416b-a813-4d290233e1e4 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:01.267170 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:01.268219 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:01.269740 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:01.270054 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] PATH_INFO: `/v3/projects/1791b565ce7e4380a238d3a40b011d8e` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:01.271521 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1791b565ce7e4380a238d3a40b011d8e)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:01.275736 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:01.364616 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1791b565ce7e4380a238d3a40b011d8e', 'request_id': 'req-7293d975-49fa-4ecd-9425-f87a8e53e02a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:01.375686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1791b565ce7e4380a238d3a40b011d8e', 'request_id': 'req-7293d975-49fa-4ecd-9425-f87a8e53e02a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:01.398828 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1791b565ce7e4380a238d3a40b011d8e', 'request_id': 'req-7293d975-49fa-4ecd-9425-f87a8e53e02a'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:01.433145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] The token cache is being invalidate because project 1791b565ce7e4380a238d3a40b011d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:01.434429 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:01.437292 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-7293d975-49fa-4ecd-9425-f87a8e53e02a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:01.441868 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1444/2846] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:01 2022] DELETE /identity/v3/projects/1791b565ce7e4380a238d3a40b011d8e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:01.451111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee285034-dd4c-4321-b1f1-c8bcfc4cc4d6 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:01.451111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee285034-dd4c-4321-b1f1-c8bcfc4cc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:01.451111 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee285034-dd4c-4321-b1f1-c8bcfc4cc4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:01.494470 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ee285034-dd4c-4321-b1f1-c8bcfc4cc4d6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:01.497481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ee285034-dd4c-4321-b1f1-c8bcfc4cc4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:01.659275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1403/2847] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:01.659665 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01b40-1ab8-405c-bea7-ec79f3e0a371 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:01.660137 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01b40-1ab8-405c-bea7-ec79f3e0a371 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:01.660641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef01b40-1ab8-405c-bea7-ec79f3e0a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:01.692996 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-aef01b40-1ab8-405c-bea7-ec79f3e0a371 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:01.694928 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aef01b40-1ab8-405c-bea7-ec79f3e0a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:01.706581 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1445/2848] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:01.713867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee285034-dd4c-4321-b1f1-c8bcfc4cc4d6 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:01.732572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee285034-dd4c-4321-b1f1-c8bcfc4cc4d6 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:01.742227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:01.743155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:01.743861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:01.744353 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:01.745227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:09:01.745532 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:01.747238 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:01.770286 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1404/2849] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:09:01.772513 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01b40-1ab8-405c-bea7-ec79f3e0a371 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:01.788645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef01b40-1ab8-405c-bea7-ec79f3e0a371 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:01.794415 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:01.794762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:01.795115 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:01.795468 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:01.796261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:01.798271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:01.844122 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1446/2850] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:09:01 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:09:01.848481 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:01.872116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4334eb-d103-4ed5-8b90-1ce54bbc316e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:01.873343 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:01.875310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:01.900706 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:01.929553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:01.974999 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:01.976533 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:01.977188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:01.977660 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:01.978693 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:01.981040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:02.016351 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1405/2851] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:09:01 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:09:02.020695 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:02.033931 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca34720-3820-4d48-84aa-2dd58f698258 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:02.040564 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:02.041190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.041468 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.041737 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.042396 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:02.044263 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:02.055781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6f14-eece-4c23-bede-50098e018831 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:02.066575 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1406/2852] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:09:02.067971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:02.069227 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.070402 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.070729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] PATH_INFO: `/v3/users/2cf68ada84d14fadb218fb7603fb2fc9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.071878 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:02.073915 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf68ada84d14fadb218fb7603fb2fc9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:02.077601 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:02.092190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67092031-0ebf-4b1b-a26b-6264889d6c9f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:02.100338 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:02.101969 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.102417 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.102849 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.103691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:02.106523 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:02.122055 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1407/2853] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:09:02.125965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:02.152071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d36d1a-50e0-4ffb-a611-78f5f4f8bf2e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:02.161377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1a989-c04f-415e-8745-f0c8d6247e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:02.162901 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a989-c04f-415e-8745-f0c8d6247e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.163873 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a989-c04f-415e-8745-f0c8d6247e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.165047 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a989-c04f-415e-8745-f0c8d6247e2b admin admin] PATH_INFO: `/v3/projects/93869e80d6f84de4a886687440a42aad/users/72744f228491436dbc206d82ca1f4130/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.182995 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf68ada84d14fadb218fb7603fb2fc9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:02.184332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf68ada84d14fadb218fb7603fb2fc9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:02.185531 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf68ada84d14fadb218fb7603fb2fc9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:02.193807 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1a989-c04f-415e-8745-f0c8d6247e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=93869e80d6f84de4a886687440a42aad, user_id=72744f228491436dbc206d82ca1f4130, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:02.196809 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1a989-c04f-415e-8745-f0c8d6247e2b admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:02.207004 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf68ada84d14fadb218fb7603fb2fc9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:02.222366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1408/2854] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:09:02 2022] PUT /identity/v3/projects/93869e80d6f84de4a886687440a42aad/users/72744f228491436dbc206d82ca1f4130/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:09:02.229861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.230676 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.231162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.236261 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-60b1f24d-ad3a-4a36-a719-48a3a11eb9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf68ada84d14fadb218fb7603fb2fc9'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:02.258052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1447/2855] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:09:01 2022] DELETE /identity/v3/users/2cf68ada84d14fadb218fb7603fb2fc9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:02.264221 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:02.266330 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.266641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.266894 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.270469 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:02.299994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:02.302081 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:02.418070 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1409/2856] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:02.434919 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:02.437009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1448/2857] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:02.438027 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:02.451133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:02.453047 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:02.495238 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:02.523529 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144f8ba-b26a-4ae0-acc1-f01018c5cb60 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:02.531560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568c51a-f736-4602-915f-32e9670cc643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:02.532604 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c51a-f736-4602-915f-32e9670cc643 service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.535187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c51a-f736-4602-915f-32e9670cc643 service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.535187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568c51a-f736-4602-915f-32e9670cc643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.538781 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c120f-3317-43cf-a10e-aecb8ee4fe5a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:02.543549 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:02.544228 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:02.544565 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:02.544859 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:02.553415 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568c51a-f736-4602-915f-32e9670cc643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:02.557597 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568c51a-f736-4602-915f-32e9670cc643 service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:02.558207 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:02.560805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:02.576364 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1449/2858] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:09:02.581727 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1410/2859] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:03.427847 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:03.430359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:03.460994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02d4d4-a3b5-46dd-af88-5da37390645a service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:03.475241 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:03.476355 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:03.476838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:03.476937 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] PATH_INFO: `/v3/projects/3729cbed967d4f449a60c8d38f902a91` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:03.485078 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3729cbed967d4f449a60c8d38f902a91)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:03.487164 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:03.603618 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3729cbed967d4f449a60c8d38f902a91', 'request_id': 'req-db29b725-de85-4c42-9d0a-57e1f846afa1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:03.631418 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3729cbed967d4f449a60c8d38f902a91', 'request_id': 'req-db29b725-de85-4c42-9d0a-57e1f846afa1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:03.654807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3729cbed967d4f449a60c8d38f902a91', 'request_id': 'req-db29b725-de85-4c42-9d0a-57e1f846afa1'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:03.688749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] The token cache is being invalidate because project 3729cbed967d4f449a60c8d38f902a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:03.689025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:03.690259 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-db29b725-de85-4c42-9d0a-57e1f846afa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:03.696604 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1450/2860] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:03 2022] DELETE /identity/v3/projects/3729cbed967d4f449a60c8d38f902a91 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:03.699609 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178765df-38ef-4e83-ba4a-500e78388e68 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:03.700223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178765df-38ef-4e83-ba4a-500e78388e68 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:03.700223 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178765df-38ef-4e83-ba4a-500e78388e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:03.723764 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-178765df-38ef-4e83-ba4a-500e78388e68 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:03.725666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-178765df-38ef-4e83-ba4a-500e78388e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:03.748773 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:03.820516 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1411/2861] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:03.829068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f76f9-3b98-4062-866c-0708ea026fd6 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:03.830239 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f76f9-3b98-4062-866c-0708ea026fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:03.830528 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f76f9-3b98-4062-866c-0708ea026fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:03.859564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-776f76f9-3b98-4062-866c-0708ea026fd6 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:03.860957 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-776f76f9-3b98-4062-866c-0708ea026fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:03.874229 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1451/2862] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:03.877182 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178765df-38ef-4e83-ba4a-500e78388e68 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:03.889259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178765df-38ef-4e83-ba4a-500e78388e68 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:03.894137 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:03.894789 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:03.895065 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:03.895341 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] PATH_INFO: `/v3/domains` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:03.896134 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:09:03.896446 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:03.898859 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:03.918522 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1412/2863] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:09:03.920451 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f76f9-3b98-4062-866c-0708ea026fd6 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:03.931401 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f76f9-3b98-4062-866c-0708ea026fd6 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:03.939206 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:03.940410 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:03.947587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:03.947952 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:03.948842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:03.951649 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:04.019021 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1452/2864] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:09:03 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:09:04.025284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:04.040668 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799661c-2289-408f-a02e-d11810db8352 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:04.260987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:04.262394 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:04.262706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:04.263212 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:04.264452 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:04.271321 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:04.328401 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1413/2865] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:09:04 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:09:04.333061 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:04.359668 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb12d-8700-40f1-957c-52b3924d9b76 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:04.377175 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:04.378138 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:04.378629 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:04.378985 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:04.379860 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:04.384817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:04.415479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1453/2866] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:09:04.418054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:04.450635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9673c-3377-4dc0-acc5-318a040275ad admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:04.466588 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb8ccb-cac6-4474-8bce-6c103de69737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:04.468056 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8ccb-cac6-4474-8bce-6c103de69737 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:04.468824 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8ccb-cac6-4474-8bce-6c103de69737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:04.469234 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb8ccb-cac6-4474-8bce-6c103de69737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:04.470355 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb8ccb-cac6-4474-8bce-6c103de69737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:04.473285 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb8ccb-cac6-4474-8bce-6c103de69737 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:04.512552 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1414/2867] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:09:04.519535 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:04.545005 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ffc4d-3eb5-4e41-beda-e6b0ba666540 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:04.553107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:04.554315 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:04.554976 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:04.555657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] PATH_INFO: `/v3/projects/65fccfe812f24cdd86e0d8ef7a95e680/users/93a9bd6e14924c21a5b5de9d90d15726/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:04.582297 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65fccfe812f24cdd86e0d8ef7a95e680, user_id=93a9bd6e14924c21a5b5de9d90d15726, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:04.587309 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:04.632662 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1454/2868] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:09:04 2022] PUT /identity/v3/projects/65fccfe812f24cdd86e0d8ef7a95e680/users/93a9bd6e14924c21a5b5de9d90d15726/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:09:04.640802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dca5e0-f2ff-41ec-9204-c18415b16953 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:04.641073 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dca5e0-f2ff-41ec-9204-c18415b16953 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:04.641484 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dca5e0-f2ff-41ec-9204-c18415b16953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:04.665397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-56dca5e0-f2ff-41ec-9204-c18415b16953 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:04.666991 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-56dca5e0-f2ff-41ec-9204-c18415b16953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:04.792239 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1415/2869] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:04.852829 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:04.859218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:05.019190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:05.019190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:05.019190 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:05.041606 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:05.052111 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc34aa-699e-4797-9ef3-6fd939217e04 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:05.060872 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:05.061532 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:05.061883 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:05.062223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:05.079743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:05.083440 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:05.102884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1455/2870] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:05.126861 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] MFA Rules not processed for user `72744f228491436dbc206d82ca1f4130`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:05.130555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:05.170689 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:05.186152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:05.190303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:05.304303 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1416/2871] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:05.311793 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:05.315626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:05.344172 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698469b-80ae-4247-9c0a-79fa189d2183 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:05.350303 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f198a0-e9ac-42ff-93b5-92dbfdb33d1d service neutron] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:05.353518 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:05.354898 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:05.355495 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:05.358473 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:05.360064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:05.364809 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:05.365966 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:05.366925 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:05.368332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:05.374486 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:05.381875 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:05.425273 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:05.426580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:05.456749 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1417/2872] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:09:05 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:09:05.460559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1456/2873] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:09:05.464997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:05.675715 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc82b6-a683-4d05-8b58-144ab8aae2bd admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:05.686020 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:05.687207 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:05.695416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:05.695416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] PATH_INFO: `/v3/users` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:05.695416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:05.695416 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:05.735057 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1418/2874] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:09:05 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:09:05.742328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:05.762852 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2f5a1-87e1-4fee-97a5-9f4516dd5471 service placement] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:05.773807 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:05.774185 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:05.774619 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:05.775659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:05.777076 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:05.780811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:05.806392 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1457/2875] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:09:05.820508 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:05.847673 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bd47d-4b37-405c-a44f-bda1ef540317 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:05.856054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:05.857403 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:05.858284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:05.858491 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] PATH_INFO: `/v3/projects/554f6c4155074d66af10c36dd02e15b7/users/0a109c1e632c48d583c2f41c9b5ac3d5/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:05.890054 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554f6c4155074d66af10c36dd02e15b7, user_id=0a109c1e632c48d583c2f41c9b5ac3d5, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:05.895785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:05.933094 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1419/2876] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:09:05 2022] PUT /identity/v3/projects/554f6c4155074d66af10c36dd02e15b7/users/0a109c1e632c48d583c2f41c9b5ac3d5/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:05.937481 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:05.957009 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb2878b-1db5-40f1-93ee-f552565cd9cc admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:06.090518 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25ac8a-6b7d-4f5e-aa0f-d60740ff863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:06.091407 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25ac8a-6b7d-4f5e-aa0f-d60740ff863f admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:06.091838 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25ac8a-6b7d-4f5e-aa0f-d60740ff863f admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:06.092380 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25ac8a-6b7d-4f5e-aa0f-d60740ff863f admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:06.096729 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25ac8a-6b7d-4f5e-aa0f-d60740ff863f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:06.104096 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25ac8a-6b7d-4f5e-aa0f-d60740ff863f admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:06.121348 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1458/2877] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 14 13:09:06.131233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:06.167691 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72a1d0-c56f-41ff-96b8-483c834d7a85 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:06.176462 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:06.177259 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:06.177602 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:06.177950 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] PATH_INFO: `/v3/projects/554f6c4155074d66af10c36dd02e15b7/users/0a109c1e632c48d583c2f41c9b5ac3d5/roles/66e1dbd98a0b4a9b8662169cd6c2433f` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:06.182937 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554f6c4155074d66af10c36dd02e15b7, user_id=0a109c1e632c48d583c2f41c9b5ac3d5, role_id=66e1dbd98a0b4a9b8662169cd6c2433f)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:06.184151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:06.201215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1420/2878] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:09:06 2022] PUT /identity/v3/projects/554f6c4155074d66af10c36dd02e15b7/users/0a109c1e632c48d583c2f41c9b5ac3d5/roles/66e1dbd98a0b4a9b8662169cd6c2433f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:07.001382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a7e8-67b1-4af6-9a62-658ca8d86aba None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:07.001963 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a7e8-67b1-4af6-9a62-658ca8d86aba None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:07.002265 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736a7e8-67b1-4af6-9a62-658ca8d86aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:07.082605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5736a7e8-67b1-4af6-9a62-658ca8d86aba None None] MFA Rules not processed for user `93a9bd6e14924c21a5b5de9d90d15726`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:07.088711 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5736a7e8-67b1-4af6-9a62-658ca8d86aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:07.324689 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:07.354011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1459/2879] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:07.376160 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:07.380593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:07.491249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:07.502893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d460b714-9562-420a-91e0-60da080fef21 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:07.508560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d3b36-c817-4864-806d-abfec18be4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:07.509479 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3b36-c817-4864-806d-abfec18be4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:07.510012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3b36-c817-4864-806d-abfec18be4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:07.510295 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d3b36-c817-4864-806d-abfec18be4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:07.528769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d3b36-c817-4864-806d-abfec18be4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:07.530299 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d3b36-c817-4864-806d-abfec18be4f8 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:07.560583 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1421/2880] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:07.575974 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:07.576286 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:07.576666 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:07.640558 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] MFA Rules not processed for user `0a109c1e632c48d583c2f41c9b5ac3d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:07.641858 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:07.807659 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1460/2881] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:07.815120 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be25f-3ff2-4556-ba41-ac76ef271724 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:07.815627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be25f-3ff2-4556-ba41-ac76ef271724 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:07.816488 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382be25f-3ff2-4556-ba41-ac76ef271724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:07.878187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-382be25f-3ff2-4556-ba41-ac76ef271724 None None] MFA Rules not processed for user `72744f228491436dbc206d82ca1f4130`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:07.881058 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-382be25f-3ff2-4556-ba41-ac76ef271724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:07.990572 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1422/2882] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:08.003797 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:08.005454 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:08.159427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54032e4f-aa57-4c03-b1cd-218696b9f5e2 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:08.179655 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c3fa0-e522-44f7-8c98-d14c493e19be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:08.180627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c3fa0-e522-44f7-8c98-d14c493e19be service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:08.180965 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c3fa0-e522-44f7-8c98-d14c493e19be service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:08.181544 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c3fa0-e522-44f7-8c98-d14c493e19be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:08.197708 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c3fa0-e522-44f7-8c98-d14c493e19be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:08.201880 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c3fa0-e522-44f7-8c98-d14c493e19be service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:08.222671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1461/2883] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:08.468430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382be25f-3ff2-4556-ba41-ac76ef271724 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:08.557961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382be25f-3ff2-4556-ba41-ac76ef271724 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:08.562666 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:08.563663 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:08.564040 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:08.564387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:08.566538 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:08.714406 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:08.716281 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:08.729781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1423/2884] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:09:09.367211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:09.368323 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:09.368820 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:09.419288 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] MFA Rules not processed for user `93a9bd6e14924c21a5b5de9d90d15726`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:09.421994 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:09.440530 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1462/2885] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:10.233227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:10.254052 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf69dc7-6d0c-437f-bb65-a1cda7f9e7ac service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:10.264441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:10.265976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:10.267251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:10.267775 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:10.272430 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:10.369340 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=100 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:10.424305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:10.424305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:10.445310 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1424/2886] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:12.048071 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:12.050075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:12.172210 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=100 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:12.195183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a070-1557-47d8-9810-860b77e81991 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:12.200683 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:12.201743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:12.201743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:12.202193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] PATH_INFO: `/v3/users/125cd1ca3426493d837e1683872a1138` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:12.203150 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=125cd1ca3426493d837e1683872a1138)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:12.205483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:12.291177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125cd1ca3426493d837e1683872a1138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:12.292424 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125cd1ca3426493d837e1683872a1138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:12.293294 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125cd1ca3426493d837e1683872a1138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:12.307196 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125cd1ca3426493d837e1683872a1138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:12.342537 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125cd1ca3426493d837e1683872a1138'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:12.375785 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1463/2887] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:09:12 2022] DELETE /identity/v3/users/125cd1ca3426493d837e1683872a1138 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:13.395802 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:13.525530 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9f5c-0e90-49a1-b029-e1f4762adaff service neutron] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:13.633475 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:13.637064 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:13.637645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:13.638251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] PATH_INFO: `/v3/projects/111e9507d8af4bf49a1813e68e0c5f25` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:13.640399 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=111e9507d8af4bf49a1813e68e0c5f25)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:13.642942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:13.766555 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111e9507d8af4bf49a1813e68e0c5f25', 'request_id': 'req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:13.779573 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111e9507d8af4bf49a1813e68e0c5f25', 'request_id': 'req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:13.799711 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111e9507d8af4bf49a1813e68e0c5f25', 'request_id': 'req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:13.815546 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] The token cache is being invalidate because project 111e9507d8af4bf49a1813e68e0c5f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:13.815843 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:13.816548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:13.818702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1425/2888] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:13 2022] DELETE /identity/v3/projects/111e9507d8af4bf49a1813e68e0c5f25 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:13.823634 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:13.825362 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:13.844862 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d2f4-0e9a-4bc5-9bfa-8a19556e4b07 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:13.957171 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:13.959305 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:13.960533 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:13.961242 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] PATH_INFO: `/v3/users/8d186476fd484cebac1c4dc293d53d7b` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:13.962642 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d186476fd484cebac1c4dc293d53d7b)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:13.967277 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:14.038201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d186476fd484cebac1c4dc293d53d7b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:14.039842 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d186476fd484cebac1c4dc293d53d7b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:14.040663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d186476fd484cebac1c4dc293d53d7b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:14.055991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d186476fd484cebac1c4dc293d53d7b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:14.073347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:14.074897 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d186476fd484cebac1c4dc293d53d7b'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:14.107522 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1464/2889] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:09:13 2022] DELETE /identity/v3/users/8d186476fd484cebac1c4dc293d53d7b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:14.823186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:14.827616 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:14.856330 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15fdb3-9a94-483d-b4b8-c4dd4761d669 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:14.971642 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:15.007308 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:15.008039 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:15.008439 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:15.008710 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] PATH_INFO: `/v3/projects/10f5c0d085654153ab58943c035f79ad` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:15.009997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f5c0d085654153ab58943c035f79ad)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:15.012155 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:15.106354 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f5c0d085654153ab58943c035f79ad', 'request_id': 'req-d613b860-0799-40ec-a75a-636272383f08'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:15.119115 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f5c0d085654153ab58943c035f79ad', 'request_id': 'req-d613b860-0799-40ec-a75a-636272383f08'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:15.134645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f5c0d085654153ab58943c035f79ad', 'request_id': 'req-d613b860-0799-40ec-a75a-636272383f08'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:15.159071 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] The token cache is being invalidate because project 10f5c0d085654153ab58943c035f79ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:15.159494 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:15.160513 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:15.172329 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1426/2890] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:14 2022] DELETE /identity/v3/projects/10f5c0d085654153ab58943c035f79ad => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:22.316806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:22.319697 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:22.512117 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bdbd2-4e8f-450e-9d62-926c38a6d9da admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:22.651283 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd68c5b-807e-475a-be77-e48712e428d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:22.652146 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68c5b-807e-475a-be77-e48712e428d2 service placement] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:22.653369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68c5b-807e-475a-be77-e48712e428d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:22.653369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68c5b-807e-475a-be77-e48712e428d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:22.654832 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-fcd68c5b-807e-475a-be77-e48712e428d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:22.675517 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd68c5b-807e-475a-be77-e48712e428d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:22.677511 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd68c5b-807e-475a-be77-e48712e428d2 service placement] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:22.712070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1465/2891] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:24.383505 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:24.385360 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:24.468079 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613b860-0799-40ec-a75a-636272383f08 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:24.472030 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:24.472688 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:24.472965 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:24.473233 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:24.475900 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:24.599152 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:24.603000 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:24.626832 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1427/2892] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:32.693990 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=77,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:34.623227 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=81,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:43.814627 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:43.815223 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:43.815478 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:43.892100 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:43.893340 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:43.964806 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1466/2893] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:43.987702 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:43.989706 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:44.104975 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cf9a8-6610-4753-894f-177d9d57dea2 service cinder] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:44.111049 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:44.111661 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:44.111941 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:44.112251 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:44.121364 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:44.122957 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:44.132994 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1428/2894] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:45.877105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:45.879547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:45.895596 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a4fe7-a0c3-4915-a85a-19abb47fd41a None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:45.902681 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:45.903327 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:45.903749 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:45.904045 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] PATH_INFO: `/v3/users/72744f228491436dbc206d82ca1f4130` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:45.905483 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72744f228491436dbc206d82ca1f4130)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:45.907495 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:45.966962 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72744f228491436dbc206d82ca1f4130'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:45.968382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72744f228491436dbc206d82ca1f4130'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:45.968762 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72744f228491436dbc206d82ca1f4130'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:45.977623 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72744f228491436dbc206d82ca1f4130'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:45.991419 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72744f228491436dbc206d82ca1f4130'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.006971 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1467/2895] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:09:45 2022] DELETE /identity/v3/users/72744f228491436dbc206d82ca1f4130 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:46.201935 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:46.214101 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe2286-73f9-41fe-b34b-0620f1d01ead service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:46.283649 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:46.284325 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:46.284601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:46.284865 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] PATH_INFO: `/v3/projects/93869e80d6f84de4a886687440a42aad` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:46.286001 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93869e80d6f84de4a886687440a42aad)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:46.288655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:46.341881 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93869e80d6f84de4a886687440a42aad', 'request_id': 'req-0e3d600a-c4fb-4d40-a6bc-702056daa90f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.351681 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93869e80d6f84de4a886687440a42aad', 'request_id': 'req-0e3d600a-c4fb-4d40-a6bc-702056daa90f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.362254 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93869e80d6f84de4a886687440a42aad', 'request_id': 'req-0e3d600a-c4fb-4d40-a6bc-702056daa90f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.365670 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:46.386003 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] The token cache is being invalidate because project 93869e80d6f84de4a886687440a42aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:46.386471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.387686 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.389467 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1429/2896] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:46 2022] DELETE /identity/v3/projects/93869e80d6f84de4a886687440a42aad => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:46.394457 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:46.397426 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:46.412357 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb283e8-2ef5-4dd9-a317-ab6c9c979617 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:46.455751 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:46.476975 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:46.477648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:46.477926 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:46.478201 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] PATH_INFO: `/v3/users/0a109c1e632c48d583c2f41c9b5ac3d5` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:46.479373 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a109c1e632c48d583c2f41c9b5ac3d5)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:46.481398 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:46.538929 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a109c1e632c48d583c2f41c9b5ac3d5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.539641 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a109c1e632c48d583c2f41c9b5ac3d5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.540302 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a109c1e632c48d583c2f41c9b5ac3d5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.547919 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a109c1e632c48d583c2f41c9b5ac3d5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.562409 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-405001c4-002e-4821-b4b2-05a2d2e33f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a109c1e632c48d583c2f41c9b5ac3d5'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:46.584490 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1468/2897] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:09:46 2022] DELETE /identity/v3/users/0a109c1e632c48d583c2f41c9b5ac3d5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:46.912158 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:46.914183 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:46.932107 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d600a-c4fb-4d40-a6bc-702056daa90f admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.027568 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.028417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.028417 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.039825 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.040534 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.040810 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.041080 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] PATH_INFO: `/v3/projects/554f6c4155074d66af10c36dd02e15b7` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.042320 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=554f6c4155074d66af10c36dd02e15b7)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.044262 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.051467 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:47.053504 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:47.063813 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1469/2898] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:47.089635 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.091463 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:47.105750 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554f6c4155074d66af10c36dd02e15b7', 'request_id': 'req-be70bc09-e15e-4aad-9da9-1855fe566e1f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:47.114236 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554f6c4155074d66af10c36dd02e15b7', 'request_id': 'req-be70bc09-e15e-4aad-9da9-1855fe566e1f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:47.139997 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554f6c4155074d66af10c36dd02e15b7', 'request_id': 'req-be70bc09-e15e-4aad-9da9-1855fe566e1f'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:47.154560 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] The token cache is being invalidate because project 554f6c4155074d66af10c36dd02e15b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:47.154882 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:47.155620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-be70bc09-e15e-4aad-9da9-1855fe566e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:47.157245 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1430/2899] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:46 2022] DELETE /identity/v3/projects/554f6c4155074d66af10c36dd02e15b7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:09:47.163655 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1ab35-f064-4307-b2df-cf13db4519b3 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.163976 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1ab35-f064-4307-b2df-cf13db4519b3 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.164297 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1ab35-f064-4307-b2df-cf13db4519b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.191725 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-ecd1ab35-f064-4307-b2df-cf13db4519b3 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:47.193548 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-ecd1ab35-f064-4307-b2df-cf13db4519b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:47.204224 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda992d4-c2ec-4c6f-8bf0-f72dc07a5b36 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.274050 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1431/2900] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:47.281608 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:47.287291 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03315d-7beb-4101-82de-f52068493e7d None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.287783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03315d-7beb-4101-82de-f52068493e7d None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.288377 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03315d-7beb-4101-82de-f52068493e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.305507 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.306230 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.306585 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.306933 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.308991 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:47.321041 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.322489 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.322626 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-7d03315d-7beb-4101-82de-f52068493e7d None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:47.324620 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-7d03315d-7beb-4101-82de-f52068493e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:47.334848 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1470/2901] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:09:47.335942 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1432/2902] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:47.342193 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.354452 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138ad83-dc0e-4fad-bb19-ba57b27de8a4 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.359645 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.360310 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.360592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.360865 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.361515 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 14 13:09:47.361819 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.363480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.377686 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1471/2903] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Sep 14 13:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 14 13:09:47.382909 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03315d-7beb-4101-82de-f52068493e7d None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.401914 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03315d-7beb-4101-82de-f52068493e7d None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.410408 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.411771 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.412298 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.412792 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.413948 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.417591 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.435786 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:47.458363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1433/2904] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Sep 14 13:09:47 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 14 13:09:47.463564 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.478347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5ce8-3825-4c9d-ac21-f87824494af6 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.568805 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.569328 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.569648 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.569959 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] PATH_INFO: `/v3/users` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.570942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.573774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.605476 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1472/2905] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Sep 14 13:09:47 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 14 13:09:47.610447 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.626387 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0be1f-8c0c-4080-898b-4d00b847ded1 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.631954 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.632635 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.632907 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.633177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.633844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.635504 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.648062 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1434/2906] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:09:47.652626 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.666921 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47e1b4-fda8-414f-9885-d7ba4bfce8ea admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.672867 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d707e80-2088-4b9c-8791-4140455e0476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.673491 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707e80-2088-4b9c-8791-4140455e0476 admin admin] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.673890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707e80-2088-4b9c-8791-4140455e0476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.674161 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707e80-2088-4b9c-8791-4140455e0476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.674814 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d707e80-2088-4b9c-8791-4140455e0476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.677386 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d707e80-2088-4b9c-8791-4140455e0476 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.693412 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1473/2907] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Sep 14 13:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 14 13:09:47.697617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.709219 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebc59f-b1bb-430e-9639-9868843f3525 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:47.714382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:47.715090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] REQUEST_METHOD: `PUT` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.715365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.715640 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] PATH_INFO: `/v3/projects/cf77e410b5c5473a8be15ab05f892e08/users/15d26ef3eb604947ad3efdd457f7c4d4/roles/f325e8ec498a48e3a4eb22e6e65148f9` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.733774 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf77e410b5c5473a8be15ab05f892e08, user_id=15d26ef3eb604947ad3efdd457f7c4d4, role_id=f325e8ec498a48e3a4eb22e6e65148f9)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:47.736458 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:47.752867 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1435/2908] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Sep 14 13:09:47 2022] PUT /identity/v3/projects/cf77e410b5c5473a8be15ab05f892e08/users/15d26ef3eb604947ad3efdd457f7c4d4/roles/f325e8ec498a48e3a4eb22e6e65148f9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:09:47.764987 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52741f9-bcb6-4deb-9aa2-e36eb155e993 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:47.765271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52741f9-bcb6-4deb-9aa2-e36eb155e993 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:47.765547 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52741f9-bcb6-4deb-9aa2-e36eb155e993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:47.801133 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-b52741f9-bcb6-4deb-9aa2-e36eb155e993 None None] MFA Rules not processed for user `15d26ef3eb604947ad3efdd457f7c4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:47.802956 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-b52741f9-bcb6-4deb-9aa2-e36eb155e993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:47.891905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1474/2909] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:47.907748 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:47.909610 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:48.019719 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185199c0-7dd4-424c-a477-b7f55f35f52e admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:48.025346 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f149e2e-3350-4738-a299-686f0bfea2cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05fad60cd02c4c2295beb15783aecfc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:48.025971 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149e2e-3350-4738-a299-686f0bfea2cc service cinder] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:48.026249 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149e2e-3350-4738-a299-686f0bfea2cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:48.026519 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149e2e-3350-4738-a299-686f0bfea2cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:48.036284 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f149e2e-3350-4738-a299-686f0bfea2cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:48.037766 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f149e2e-3350-4738-a299-686f0bfea2cc service cinder] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:48.049163 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1436/2910] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:48.079754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52741f9-bcb6-4deb-9aa2-e36eb155e993 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:48.132240 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:48.187964 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52741f9-bcb6-4deb-9aa2-e36eb155e993 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:48.194675 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:48.195887 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:48.196347 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:48.196801 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] PATH_INFO: `/v3/users/15d26ef3eb604947ad3efdd457f7c4d4` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:48.198332 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d26ef3eb604947ad3efdd457f7c4d4)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:48.200574 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:48.264052 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d26ef3eb604947ad3efdd457f7c4d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:48.265658 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d26ef3eb604947ad3efdd457f7c4d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:48.266287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d26ef3eb604947ad3efdd457f7c4d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:48.279154 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d26ef3eb604947ad3efdd457f7c4d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:48.293382 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d26ef3eb604947ad3efdd457f7c4d4'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:48.312525 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1475/2911] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:09:48 2022] DELETE /identity/v3/users/15d26ef3eb604947ad3efdd457f7c4d4 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:09:48.319078 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:48.319822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:48.319822 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:48.341090 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:48.342226 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:48.412617 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1437/2912] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:48.422657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:48.424344 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:48.508582 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ec295-98b2-4187-8df3-7d9a445bf1cb admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:48.512218 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb47b18-42db-4411-adfc-1de52e5d49cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5ca117fa96d412e9bda506591a01fbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:48.512827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47b18-42db-4411-adfc-1de52e5d49cc service neutron] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:48.513108 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47b18-42db-4411-adfc-1de52e5d49cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:48.513390 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb47b18-42db-4411-adfc-1de52e5d49cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:48.523730 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb47b18-42db-4411-adfc-1de52e5d49cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:48.525493 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb47b18-42db-4411-adfc-1de52e5d49cc service neutron] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:48.535580 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1476/2913] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 14 13:09:48.864783 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:48.866632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:48.886848 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adcf1e-6426-4fff-9cb2-fd7d56a6db6e None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:48.892370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:48.897945 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:48.898580 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:48.899108 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] PATH_INFO: `/v3/projects/cf77e410b5c5473a8be15ab05f892e08` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:48.901460 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf77e410b5c5473a8be15ab05f892e08)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:48.904591 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:48.955651 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:48.969593 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf77e410b5c5473a8be15ab05f892e08', 'request_id': 'req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:48.978142 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf77e410b5c5473a8be15ab05f892e08', 'request_id': 'req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:48.991441 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf77e410b5c5473a8be15ab05f892e08', 'request_id': 'req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:49.003961 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] The token cache is being invalidate because project cf77e410b5c5473a8be15ab05f892e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:09:49.004275 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:49.005540 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:09:49.007188 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1438/2914] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:09:48 2022] DELETE /identity/v3/projects/cf77e410b5c5473a8be15ab05f892e08 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:09:50.327068 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb842f74-365b-4f9c-895d-3925bb22cadc None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:50.327605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb842f74-365b-4f9c-895d-3925bb22cadc None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:50.327605 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb842f74-365b-4f9c-895d-3925bb22cadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:50.350931 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-bb842f74-365b-4f9c-895d-3925bb22cadc None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:50.352211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-bb842f74-365b-4f9c-895d-3925bb22cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:50.387600 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:09:50.423480 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1477/2915] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:09:50.448734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:50.450260 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:50.541781 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d1a4-88bb-4b35-91ce-c4af8c0cc442 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:50.548165 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:50.549177 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:50.549456 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:50.549721 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:50.560253 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:50.561871 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:50.577622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1439/2916] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:54.473126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee2b67-fd37-479a-ae41-1dc976a34283 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:54.473126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee2b67-fd37-479a-ae41-1dc976a34283 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:54.473126 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee2b67-fd37-479a-ae41-1dc976a34283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:54.491514 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-beee2b67-fd37-479a-ae41-1dc976a34283 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:54.492817 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-beee2b67-fd37-479a-ae41-1dc976a34283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:54.500989 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1478/2917] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:54.523646 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:54.535305 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d5179-eca2-4baf-a085-e76c1b14b2a4 service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:54.542413 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:54.543012 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:54.543292 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:54.543565 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:54.552444 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:54.554016 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:54.563891 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1440/2918] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:09:57.639701 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343068-77f2-4464-a18c-5635aa33b4dd None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:57.640428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343068-77f2-4464-a18c-5635aa33b4dd None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:57.640428 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d343068-77f2-4464-a18c-5635aa33b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:57.663300 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-5d343068-77f2-4464-a18c-5635aa33b4dd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:09:57.664743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-5d343068-77f2-4464-a18c-5635aa33b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:57.673674 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1479/2919] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:09:57.697895 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:09:57.699482 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:09:57.716331 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13190fad-f082-4cc2-9dac-30847793081f service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:09:57.722314 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:09:57.722936 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:09:57.723215 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:09:57.723487 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:09:57.733289 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:09:57.734940 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:09:57.746184 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1441/2920] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:10:00.826741 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8f369-ed37-474b-a60b-7466ef183c87 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:00.827337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8f369-ed37-474b-a60b-7466ef183c87 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:00.827337 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8f369-ed37-474b-a60b-7466ef183c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:00.848209 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-35f8f369-ed37-474b-a60b-7466ef183c87 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:00.850105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-35f8f369-ed37-474b-a60b-7466ef183c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:00.859213 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1480/2921] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:10:00.886382 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:00.898379 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b481fc-06b3-488f-8b81-46f678f4939d service nova] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:00.904486 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3f0cc-cc79-4758-a7c6-ab95e316254d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:00.905089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3f0cc-cc79-4758-a7c6-ab95e316254d service nova] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:00.905370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3f0cc-cc79-4758-a7c6-ab95e316254d service nova] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:00.905645 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3f0cc-cc79-4758-a7c6-ab95e316254d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:00.915322 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3f0cc-cc79-4758-a7c6-ab95e316254d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:00.916953 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3f0cc-cc79-4758-a7c6-ab95e316254d service nova] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:00.926769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1442/2922] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:10:10.842205 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=20 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:10:10.922366 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:DELETE=5,keystone:SELECT=63,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:10:16.249718 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af427f-7384-4f2e-a04f-f97352a49c43 None None] REQUEST_METHOD: `POST` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:16.250246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af427f-7384-4f2e-a04f-f97352a49c43 None None] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:16.250246 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af427f-7384-4f2e-a04f-f97352a49c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:16.277690 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.auth.core [None req-11af427f-7384-4f2e-a04f-f97352a49c43 None None] MFA Rules not processed for user `93a9bd6e14924c21a5b5de9d90d15726`. Rule list: `[]` (Enabled: `True`). {{(pid=81481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:16.279890 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-11af427f-7384-4f2e-a04f-f97352a49c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:16.339290 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1481/2923] 10.222.0.50 () {58 vars in 958 bytes} [Wed Sep 14 13:10:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:10:26.331905 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=25 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:10:29.447854 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0e898-776d-4adb-9af3-6cf3e289b1bd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:29.448457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0e898-776d-4adb-9af3-6cf3e289b1bd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:29.448457 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0e898-776d-4adb-9af3-6cf3e289b1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:29.472987 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-20f0e898-776d-4adb-9af3-6cf3e289b1bd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:29.474187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-20f0e898-776d-4adb-9af3-6cf3e289b1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:29.482899 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1443/2924] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:10:29.504671 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af427f-7384-4f2e-a04f-f97352a49c43 None None] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:29.518379 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af427f-7384-4f2e-a04f-f97352a49c43 None None] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:29.523787 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:29.524496 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:29.524777 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:29.525321 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:29.533572 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:29.535145 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:29.545072 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1482/2925] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:10:32.734154 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb3b5d-b77f-4107-a149-e4ca016eb8fd None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:32.734769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb3b5d-b77f-4107-a149-e4ca016eb8fd None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:32.734769 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb3b5d-b77f-4107-a149-e4ca016eb8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:32.756164 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-09eb3b5d-b77f-4107-a149-e4ca016eb8fd None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:32.757571 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-09eb3b5d-b77f-4107-a149-e4ca016eb8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:32.766606 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1444/2926] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:10:32.787652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:32.799754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb70362-4b05-4fff-8bce-253fa1965854 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:32.805289 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:32.805923 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:32.806942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:32.807427 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:32.815896 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:32.818479 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:32.840917 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1483/2927] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:10:35.857784 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d8f7-aafc-4ba1-8906-ae6b129929a5 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:35.858373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d8f7-aafc-4ba1-8906-ae6b129929a5 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:35.858373 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d8f7-aafc-4ba1-8906-ae6b129929a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:35.878485 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-bf23d8f7-aafc-4ba1-8906-ae6b129929a5 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:35.879692 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-bf23d8f7-aafc-4ba1-8906-ae6b129929a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:35.889652 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1445/2928] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:10:35.910526 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:35.923130 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f00d5b7-190c-426e-b331-56c61437fa3a service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:35.928913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:35.929554 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:35.929833 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:35.930105 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:35.939981 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:35.941592 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:35.952889 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1484/2929] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:10:40.105979 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d42f-ee2f-42f1-846b-8113b73c2616 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:40.106844 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d42f-ee2f-42f1-846b-8113b73c2616 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:40.107066 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0d42f-ee2f-42f1-846b-8113b73c2616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:40.128955 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-fed0d42f-ee2f-42f1-846b-8113b73c2616 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:40.130187 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-fed0d42f-ee2f-42f1-846b-8113b73c2616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:40.144734 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1446/2930] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 14 13:10:40.174443 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:40.187472 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1f180-6cbe-4db7-8b7d-4e854e5b1185 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:40.193652 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:40.194359 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:40.194743 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:40.195082 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:40.206557 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:40.209824 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:40.222916 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1485/2931] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:10:41.510162 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87864b-678d-4947-ab8f-6d7ca0e3a4ab None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:41.510687 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87864b-678d-4947-ab8f-6d7ca0e3a4ab None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:41.511118 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87864b-678d-4947-ab8f-6d7ca0e3a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:41.550105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-1c87864b-678d-4947-ab8f-6d7ca0e3a4ab None None] MFA Rules not processed for user `c363f0babd8d4180bd4f0dd67bb6b892`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:41.551336 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1c87864b-678d-4947-ab8f-6d7ca0e3a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:41.619497 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1447/2932] 10.222.0.50 () {58 vars in 967 bytes} [Wed Sep 14 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:10:41.673850 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:41.675586 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:41.765298 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fefa8-3733-4ff2-acb0-094e4f083df8 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:41.770413 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59ec11c9fac7430c927f894959023e36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:41.771035 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:41.771314 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:41.771587 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:41.784152 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:41.785774 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:41.796178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1486/2933] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Sep 14 13:10:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 14 13:10:43.326972 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] REQUEST_METHOD: `POST` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:43.327641 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:43.328705 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:43.372091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.auth.core [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] MFA Rules not processed for user `4b5c40417fe143e3b4a100405e55b647`. Rule list: `[]` (Enabled: `True`). {{(pid=81482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 14 13:10:43.374835 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:43.387933 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1448/2934] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Sep 14 13:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 14 13:10:43.410559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:43.435584 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08812b6b-b33a-4dfb-ba3f-53f57f2ee23c service swift] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:43.448271 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3faaacdf2ff54c06bb4eebf13533a72a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:43.449643 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] REQUEST_METHOD: `GET` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:43.450383 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:43.451368 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:43.476754 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:43.483070 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:43.500039 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1487/2935] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:10:49.578002 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:49.579996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:49.593431 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a144-c692-4219-9fd3-ffe971b1f6e7 None None] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:49.598116 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:49.598752 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:49.599031 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:49.599304 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] PATH_INFO: `/v3/users/0dbee176f5c64c54a80a08f9ae48906b` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:49.600471 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dbee176f5c64c54a80a08f9ae48906b)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:49.602671 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:49.655553 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dbee176f5c64c54a80a08f9ae48906b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:49.656235 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dbee176f5c64c54a80a08f9ae48906b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:49.656847 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dbee176f5c64c54a80a08f9ae48906b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:49.664151 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dbee176f5c64c54a80a08f9ae48906b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:49.677091 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dbee176f5c64c54a80a08f9ae48906b'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:49.692105 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1449/2936] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:10:49 2022] DELETE /identity/v3/users/0dbee176f5c64c54a80a08f9ae48906b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 14 13:10:49.880770 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:49.893663 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164137f2-afbc-4ac8-ad2f-9302750e86f0 service nova] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:49.968370 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:49.969025 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:49.969301 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:49.969573 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] PATH_INFO: `/v3/projects/3b298d45e41a4a8f8f4c7385b25638d8` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:49.971075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b298d45e41a4a8f8f4c7385b25638d8)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:49.972710 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:50.021576 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:10:50.045559 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b298d45e41a4a8f8f4c7385b25638d8', 'request_id': 'req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.053183 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b298d45e41a4a8f8f4c7385b25638d8', 'request_id': 'req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.064174 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b298d45e41a4a8f8f4c7385b25638d8', 'request_id': 'req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.077178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] The token cache is being invalidate because project 3b298d45e41a4a8f8f4c7385b25638d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:10:50.077178 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.078287 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.079827 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1488/2937] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:10:49 2022] DELETE /identity/v3/projects/3b298d45e41a4a8f8f4c7385b25638d8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:10:50.084363 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:50.085850 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:50.101601 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa394b-0ec2-4151-aa6b-9da400582223 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:50.143209 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:10:50.175196 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:50.175785 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:50.176089 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:50.176365 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] PATH_INFO: `/v3/users/f0ec13b9f1f840cbb40b881212f007a6` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:50.177614 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ec13b9f1f840cbb40b881212f007a6)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:50.179570 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:50.245264 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ec13b9f1f840cbb40b881212f007a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.246334 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ec13b9f1f840cbb40b881212f007a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.246990 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ec13b9f1f840cbb40b881212f007a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.255632 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ec13b9f1f840cbb40b881212f007a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.275831 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ec13b9f1f840cbb40b881212f007a6'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.293185 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1450/2938] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:10:50 2022] DELETE /identity/v3/users/f0ec13b9f1f840cbb40b881212f007a6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:10:50.507717 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:10:50.509387 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:10:50.527727 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4cc42-7260-45f0-8b1e-73bd5c5280a7 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:10:50.608369 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:10:50.609213 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:10:50.609494 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:10:50.609765 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] PATH_INFO: `/v3/projects/475a1831d75f41dca01cb8a07cd4a7e0` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:10:50.611075 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475a1831d75f41dca01cb8a07cd4a7e0)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:10:50.615173 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:10:50.718884 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475a1831d75f41dca01cb8a07cd4a7e0', 'request_id': 'req-ca640eb7-e63b-4fcf-85a8-69d6df866953'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.733177 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475a1831d75f41dca01cb8a07cd4a7e0', 'request_id': 'req-ca640eb7-e63b-4fcf-85a8-69d6df866953'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.746269 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475a1831d75f41dca01cb8a07cd4a7e0', 'request_id': 'req-ca640eb7-e63b-4fcf-85a8-69d6df866953'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.761250 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] The token cache is being invalidate because project 475a1831d75f41dca01cb8a07cd4a7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:10:50.761794 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.762948 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:10:50.764942 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1489/2939] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:10:50 2022] DELETE /identity/v3/projects/475a1831d75f41dca01cb8a07cd4a7e0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:11:00.287996 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=37,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:11:00.756816 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:11:13.258370 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:11:13.261720 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:11:13.286123 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ba3a-6cf4-40ea-908f-b803fa8441ad admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:11:13.360369 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:11:13.360845 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:11:13.361121 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:11:13.361397 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] PATH_INFO: `/v3/users/93a9bd6e14924c21a5b5de9d90d15726` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:11:13.362622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a9bd6e14924c21a5b5de9d90d15726)` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:11:13.364605 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:11:13.440084 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a9bd6e14924c21a5b5de9d90d15726'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.440893 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a9bd6e14924c21a5b5de9d90d15726'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.441863 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a9bd6e14924c21a5b5de9d90d15726'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.454627 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a9bd6e14924c21a5b5de9d90d15726'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.479124 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.notifications [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a9bd6e14924c21a5b5de9d90d15726'} {{(pid=81482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.499011 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1451/2940] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Sep 14 13:11:13 2022] DELETE /identity/v3/users/93a9bd6e14924c21a5b5de9d90d15726 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:11:13.723084 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Authenticating user token {{(pid=81481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:11:13.725591 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.fernet_utils [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:11:13.748198 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640eb7-e63b-4fcf-85a8-69d6df866953 admin admin] Validating token access rules against request {{(pid=81481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:11:13.835090 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c40417fe143e3b4a100405e55b647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aef2b4eee2a24765906ec0ab593443d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:11:13.836211 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:11:13.836681 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:11:13.837151 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] PATH_INFO: `/v3/projects/65fccfe812f24cdd86e0d8ef7a95e680` {{(pid=81481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:11:13.839396 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65fccfe812f24cdd86e0d8ef7a95e680)` {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:11:13.843024 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] RBAC: Authorization granted {{(pid=81481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:11:13.924262 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65fccfe812f24cdd86e0d8ef7a95e680', 'request_id': 'req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.936212 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65fccfe812f24cdd86e0d8ef7a95e680', 'request_id': 'req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.948107 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65fccfe812f24cdd86e0d8ef7a95e680', 'request_id': 'req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6'} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.964657 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] The token cache is being invalidate because project 65fccfe812f24cdd86e0d8ef7a95e680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 14 13:11:13.965011 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.965811 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG keystone.notifications [None req-776c3bc8-3a51-463c-9d4d-e2d55ee8f2f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 14 13:11:13.967539 dv-cinder-820027-30-smb devstack@keystone.service[81481]: [pid: 81481|app: 0|req: 1490/2941] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Sep 14 13:11:13 2022] DELETE /identity/v3/projects/65fccfe812f24cdd86e0d8ef7a95e680 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 14 13:11:23.493622 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:11:23.958913 dv-cinder-820027-30-smb devstack@keystone.service[81481]: DEBUG dbcounter [-] [81481] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 14 13:14:28.163743 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Authenticating user token {{(pid=81482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 14 13:14:28.165192 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:14:28.238795 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0980d3-8e4e-43f8-980d-88493b96d309 admin admin] Validating token access rules against request {{(pid=81482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 14 13:14:28.298587 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c66cbd8-988e-464a-b0a5-f91948537857 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d6d17c6b22402ca39158a737027f11', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8fb36899b414894804cf9b6d5148c9a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 14 13:14:28.299191 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cbd8-988e-464a-b0a5-f91948537857 service placement] REQUEST_METHOD: `GET` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 14 13:14:28.299466 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cbd8-988e-464a-b0a5-f91948537857 service placement] SCRIPT_NAME: `/identity` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 14 13:14:28.299736 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66cbd8-988e-464a-b0a5-f91948537857 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 14 13:14:28.301472 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.fernet_utils [None req-3c66cbd8-988e-464a-b0a5-f91948537857 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 14 13:14:28.313186 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66cbd8-988e-464a-b0a5-f91948537857 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 14 13:14:28.314746 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c66cbd8-988e-464a-b0a5-f91948537857 service placement] RBAC: Authorization granted {{(pid=81482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 14 13:14:28.324511 dv-cinder-820027-30-smb devstack@keystone.service[81482]: [pid: 81482|app: 0|req: 1452/2942] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Sep 14 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 14 13:14:38.320335 dv-cinder-820027-30-smb devstack@keystone.service[81482]: DEBUG dbcounter [-] [81482] Writing DB stats keystone:SELECT=58 {{(pid=81482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}